-- Logs begin at Fri 2022-05-27 08:52:12 UTC, end at Fri 2022-05-27 10:05:26 UTC. -- May 27 09:29:50.684607 dv-cinder-797608-21-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 09:29:50.697585 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 09:29:50 2022] *** May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: nodename: dv-cinder-797608-21-iscsi May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: machine: x86_64 May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: clock source: unix May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: pcre jit disabled May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: detected number of CPU cores: 4 May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: current working directory: / May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: detected binary path: /usr/bin/uwsgi-core May 27 09:29:50.699593 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: your processes number limit is 47680 May 27 09:29:50.700341 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: your memory page size is 4096 bytes May 27 09:29:50.700341 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: detected max file descriptor number: 2048 May 27 09:29:50.700341 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: lock engine: pthread robust mutexes May 27 09:29:50.700341 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: thunder lock: enabled May 27 09:29:50.700341 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 09:29:50.700341 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 09:29:50.744572 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: Python main interpreter initialized at 0x55898fffe9c0 May 27 09:29:50.744572 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: python threads support enabled May 27 09:29:50.744572 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: your server socket listen backlog is limited to 100 connections May 27 09:29:50.744572 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: your mercy for graceful operations on workers is 90 seconds May 27 09:29:50.744968 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: mapped 403077 bytes (393 KB) for 2 cores May 27 09:29:50.744968 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: *** Operational MODE: preforking *** May 27 09:29:50.745194 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: *** uWSGI is running in multiple interpreter mode *** May 27 09:29:50.745194 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: spawned uWSGI master process (pid: 103240) May 27 09:29:50.745408 dv-cinder-797608-21-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 09:29:50.745971 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: spawned uWSGI worker 1 (pid: 103241, cores: 1) May 27 09:29:50.751313 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: spawned uWSGI worker 2 (pid: 103242, cores: 1) May 27 09:29:50.751313 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 09:29:51.912608 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 09:29:51.914461 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 09:29:52.627702 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:29:52.627702 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: from cryptography.utils import int_from_bytes May 27 09:29:52.628437 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:29:52.628437 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: from cryptography.utils import int_from_bytes May 27 09:29:52.629136 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:29:52.629136 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: from cryptography.utils import int_from_bytes May 27 09:29:52.629452 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:29:52.629452 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: from cryptography.utils import int_from_bytes May 27 09:29:55.222114 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:29:55.222665 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:29:55.223021 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:29:55.223114 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:29:55.223314 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:29:55.223416 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:29:55.223499 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:29:55.223579 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:29:55.223668 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:29:55.223762 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:29:55.223844 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.224073 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.224171 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.224405 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.224504 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.224730 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.224826 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.225052 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.225155 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.225387 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.225490 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.225700 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.225787 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.226014 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.226098 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.226334 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.226428 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.226589 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.226688 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.226902 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.226989 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.227217 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.227334 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-21-iscsi {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.227563 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.227661 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-21-iscsi {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.227869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.227957 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.228177 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.228271 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.228488 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.228597 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.229317 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.229658 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.229893 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.229980 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.230199 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.230285 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.230510 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.230689 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.231027 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.231177 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.231374 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.231471 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.231671 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.231764 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.232005 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.232126 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.232325 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.232439 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.232644 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.232736 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.232960 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.233057 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.233284 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.233388 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.233595 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.233693 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.233902 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.233993 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.234219 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.234309 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-21-iscsi {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.234596 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.234695 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-21-iscsi {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.234908 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.235005 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.235220 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.235358 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.235570 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.235671 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.235957 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.236266 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.236366 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.236586 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.236677 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.236906 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.236998 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.237216 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.237321 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.237523 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.237624 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.237844 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.237934 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.238160 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.238261 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.238475 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.238567 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.238776 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.238867 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.239082 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.239180 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.239410 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.239502 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.239722 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.239819 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.240022 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.240120 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.240324 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.240415 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.240565 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.240662 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.240867 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.240959 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.241180 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.241273 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.241495 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.241598 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.241813 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.241909 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.242065 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.242158 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.242307 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.242407 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.242614 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.242704 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.242931 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.243022 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.243239 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.243352 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.243567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.243658 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.243873 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.243975 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.244179 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.244283 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.245035 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.245193 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.245335 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.245473 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.245620 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.245776 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.245915 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.246063 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.246219 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.246371 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.246520 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.246659 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.246833 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.246980 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.247144 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.247348 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.247495 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.247634 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.247795 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.247934 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.248106 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.248261 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.248401 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.248538 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.248720 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.248864 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.249038 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.249203 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.249345 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.249484 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.249650 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.249814 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.250034 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.250185 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.250334 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.250473 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.250610 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.250754 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.250900 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.251038 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.251183 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.251353 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.251498 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.251662 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.251952 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.252093 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.252238 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.252385 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.252523 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.252661 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.252811 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.252950 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.253087 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.253237 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.253387 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.253539 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.253689 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.253833 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.253987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.254127 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.254273 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.254423 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.254568 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.254706 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.254844 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.254981 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.255124 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.255270 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.255464 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.255622 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.255761 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.255899 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.256036 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.256184 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.256323 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.256468 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.256607 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.256751 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.256889 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.257034 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.257173 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.257317 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.257471 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.257611 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.257757 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.257896 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.258041 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.258178 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.258323 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.258470 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.258608 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.258754 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.258899 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.259056 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.259195 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.259372 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.259513 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.259663 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.259810 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.259972 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.260120 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.260260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.260398 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.260544 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.260683 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.260821 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.260958 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.261139 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.261300 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.261439 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.261577 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.261748 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.261901 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.262046 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.262193 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.262338 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.262477 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.262627 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.262766 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.262936 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.263102 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.263242 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.263420 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.263569 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.263709 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.263848 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.263995 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.264134 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.264279 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.264425 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.264571 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.264722 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.264862 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.265018 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.265157 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.265302 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.265446 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.265593 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.265731 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.265869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.266008 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.266174 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.266321 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.266476 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.266615 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.266778 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.266935 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.267113 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.267259 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.267476 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.267624 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:29:55.267770 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.267916 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.268086 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.268242 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.268415 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.268568 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.268741 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.268898 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.269050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.269198 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.269339 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.269477 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.269651 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.269804 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.269975 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.270134 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.270274 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.270412 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.270582 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.270729 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.270889 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.271029 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.271194 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.271378 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.271527 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.271666 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.271845 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.272086 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.272250 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.272398 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.272537 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.272676 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.272841 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.272988 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.273135 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.273283 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.273429 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.273572 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.273731 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.273885 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.274025 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.274170 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.274311 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.274449 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.274605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.274757 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.274896 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.275036 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.275203 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.275404 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.275592 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.275739 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.275937 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.276089 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.276263 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.276423 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.276588 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.276741 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.276892 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.277055 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.277199 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.277349 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.277490 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.277628 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.277816 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.277961 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.278151 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.278316 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.278463 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.278609 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.278775 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.278946 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.279092 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.279245 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.279422 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.279568 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.279724 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.279884 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.280037 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.280190 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.280377 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.280529 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.280675 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.280828 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.280982 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.281127 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.281270 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.281414 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.281558 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.281703 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.281855 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.282001 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.282144 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.282288 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.282432 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.282582 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.282746 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.282892 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.283035 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.283179 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.283370 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.283521 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.283693 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.283843 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.283987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.284131 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.284282 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.284440 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.284585 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.284740 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.284886 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.285044 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.285189 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.285346 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.285492 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.285642 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.285787 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.285931 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.286076 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.286231 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.286377 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.286528 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.286683 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.286828 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.286973 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.287125 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.287297 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.287464 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.287618 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.287763 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.287919 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.288066 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.288210 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.288355 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.288509 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.288655 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.288808 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.288959 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.289105 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.289256 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.289402 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.289545 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.289725 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.289886 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.290040 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.290186 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.290330 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.290484 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.290648 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.290801 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.290953 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.291107 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.291848 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.292010 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.292158 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.292303 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.292454 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.292599 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.292743 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.292896 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.293059 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.293205 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.293349 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.293493 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.293636 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.293793 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.293939 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.293939 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.294233 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.294380 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.294530 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.294684 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.294840 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.294985 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.295129 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.295294 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.295459 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.295606 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.295750 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.295893 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.296037 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.296181 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.296335 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.296481 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.296632 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.296787 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.296931 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.297082 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.297240 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.297387 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.297537 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.297681 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.297825 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.298005 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.298164 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.298310 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.298456 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.298600 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.298765 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.298995 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.299153 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.299346 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.299500 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.299645 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.299790 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.299946 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.300093 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.300238 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.300382 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.300527 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.300671 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.300835 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.300981 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.301124 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.301267 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.301429 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.301576 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.301729 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.301874 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.302025 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.302178 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.302323 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.302475 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.302622 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.302775 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.302919 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.303062 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.303213 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.303397 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.303544 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.303689 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.303840 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.303985 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.304135 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.304291 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.304437 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.304581 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.304735 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.304880 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.305023 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.305176 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.305322 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.305465 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.305609 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.305815 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.305967 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.306129 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.306277 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.306420 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.306574 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.306719 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.307457 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.307613 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.307767 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.307914 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.308059 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.308203 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.308360 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.308513 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.308658 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.308802 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.308946 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.309100 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.309257 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.309404 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.309556 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.309701 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.309845 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.309989 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.310142 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.310287 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.310431 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.310574 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.310718 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.310718 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.311013 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.311159 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.311324 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.311485 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.311631 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.311784 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.311930 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.312076 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.312221 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.312364 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.312508 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.312661 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.312806 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.312960 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.313105 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.313258 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.313403 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.313556 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.313708 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.313853 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.313996 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.314155 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.314345 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.314508 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.314664 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.314820 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.314964 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.315108 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.315267 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.315471 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.315617 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.315768 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.315913 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.316057 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.316210 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.316364 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.316516 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.316660 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.316814 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.316958 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.317110 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.317265 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.317412 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.317556 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.317700 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.317844 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.317996 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.318141 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.318284 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.318429 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.318573 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.318735 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.318881 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.319025 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.319177 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.319344 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.319507 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.319666 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.319813 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.319958 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.320102 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.320254 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.320407 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.320562 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.320719 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.320863 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.321007 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.321160 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.321306 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.321458 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.321605 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.321749 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.321893 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.322037 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.322190 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.322336 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.323028 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.323207 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.323405 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.323552 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.323716 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.323863 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.324008 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.324168 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.324326 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.324478 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.324634 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.324779 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.324923 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.325077 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.325221 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.325373 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.325527 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.325682 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.325827 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.325971 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.326123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.326277 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.326423 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.326567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.326712 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.326863 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.327028 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.327183 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.327355 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.327506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.327661 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.327808 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.327953 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.328170 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.328328 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.328482 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.328628 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.328772 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.328917 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.329082 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.329228 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.329373 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.329516 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.329661 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.329818 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.329966 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.330119 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.330265 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.330409 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.330553 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.330706 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.330862 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.331018 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.331177 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.331373 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.331526 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.331671 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.331832 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.331980 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.332125 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.332125 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.332399 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.332551 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.332709 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.332875 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.333033 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.333178 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.333323 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.333479 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.333624 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.333778 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.333924 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.334076 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.334232 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.334378 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.334522 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.334675 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.334839 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.334993 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.335148 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.335311 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.335462 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.335655 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.335807 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.335952 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.336096 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.336242 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.336395 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.336541 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.336685 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.336839 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.336983 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.337137 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.337292 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.337438 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.337581 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.337725 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.337870 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.338035 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.338702 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.338859 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.339006 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.339168 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.339349 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.339503 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.339658 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.339804 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.339949 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.340101 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.340246 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.340400 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.340546 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.340691 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.340834 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.340977 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.341139 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.341295 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.341447 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.341593 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.341744 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.341889 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.342033 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.342185 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.342337 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.342484 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.342628 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.342771 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.342915 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.343076 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.343221 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.343413 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.343561 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.343716 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.343870 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.344017 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.344167 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.344316 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.344460 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.344612 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.344766 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.344919 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.345074 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.345219 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.345363 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.345508 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.345662 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.345815 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.345966 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.346111 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.346254 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.346398 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.346555 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.346708 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.346864 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.347015 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.347161 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.347344 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.347505 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.347650 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.347795 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.347938 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.348082 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.348235 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.348388 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.348533 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.348683 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.348840 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.348984 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.349141 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.349294 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.349440 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.349583 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.349727 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.349878 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.350032 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.350185 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.350330 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.350473 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.350624 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.350799 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.350947 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.351091 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.351236 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.351450 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.351597 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.351825 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.351976 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.352121 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.352266 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.352418 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.352563 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.352719 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.352876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.353021 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.353165 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.353308 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.353461 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.353614 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.353794 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.353794 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.354083 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.354281 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.354693 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.354841 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.354986 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.354986 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.355302 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.355302 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.355608 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.355762 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.355907 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.356052 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.356196 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.356196 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.356492 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.356638 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.356781 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.356935 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.357080 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.357232 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.357390 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.357535 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.357686 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.357832 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.357976 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.358128 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.358275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.358425 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.358569 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.358721 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.358883 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.359037 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.359183 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.359378 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.359530 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.359676 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.359821 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.359821 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.360118 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.360265 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.360410 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.360555 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.360699 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.360867 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.361014 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.361158 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.361302 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.361448 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.361604 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.361751 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.361901 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.362046 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.362198 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.362343 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.362497 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.362643 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.362799 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.362951 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.363096 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.363240 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.363426 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.363580 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.363727 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.363878 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.364024 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.364178 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.364331 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.364484 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.364630 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.364785 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.364928 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.365073 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.365229 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.365382 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.365528 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.365679 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.365823 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.365980 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.366134 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.366278 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.366422 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.366577 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.366721 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.366877 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.367023 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.367166 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.367356 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.367509 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.367668 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.367824 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.367971 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.368116 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.368268 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.368420 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.368583 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.368739 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.368885 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.369072 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.369222 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.369398 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.369557 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.369706 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.369850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.369994 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.370139 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.370283 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.370436 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.370592 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.370738 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.370883 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.371034 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.371186 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.371364 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.371517 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.371662 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.371807 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.371951 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.372103 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.372247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.372398 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.372553 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.372698 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.372848 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.373003 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.373149 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.373292 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.373442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.373588 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.373732 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.373888 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.374034 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.374189 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.374344 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.374488 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.374632 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.374784 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.374930 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.375075 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.375075 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.375402 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.375550 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.375706 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.375859 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.376007 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.376151 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.376308 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.376467 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.376614 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.376758 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.376903 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.377048 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.377192 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.377192 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.377475 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.377619 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.377769 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.377914 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.378064 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.378452 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.378607 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.378761 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.378915 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.379061 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.379216 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.379389 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.379536 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.379680 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.379825 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.379980 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.380202 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.380398 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.380549 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.380549 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.380832 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.380978 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.381130 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.381277 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.381421 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.381589 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.381743 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.381889 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.382039 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.382185 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.382348 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.382495 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.382639 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.382784 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.382929 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.383082 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.383236 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.383413 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.383571 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.383724 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.383870 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.384015 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.384179 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.384344 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.384491 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.384648 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.384802 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.385477 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.385626 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.385772 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.385917 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.386061 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.386213 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.386367 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.386513 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.386676 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.386821 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.386973 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.387125 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.387331 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.387499 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.387647 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.387799 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.387951 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.388110 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.388263 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.388409 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.388561 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.388718 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.388869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.389029 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.389176 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.389320 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.389464 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.389608 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.389761 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.389915 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.390068 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.390214 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.390359 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.390504 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.390659 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.390878 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.391027 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.391172 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.391371 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.391525 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.391671 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.391825 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.391973 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.392118 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.392263 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.392407 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.392559 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.392716 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.392865 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.393018 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.393171 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.393329 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.393488 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.393635 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.393780 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.393925 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.394084 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.394233 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.394387 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.394540 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.394702 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.394856 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.395002 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.395154 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.395334 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.395495 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.395641 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.395786 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.395931 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.396085 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.396230 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.396375 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.396530 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.396675 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.396819 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.396819 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.397105 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.397257 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.397403 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.397547 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.397690 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.397844 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.397990 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.398134 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.398278 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.398435 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.398589 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.398734 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.398879 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.399023 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.399177 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.399371 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.399535 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.399683 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.399827 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.399972 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.400117 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.400262 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.400425 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.400631 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.401284 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.401430 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.401575 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.401728 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.401886 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.402033 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.402177 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.402322 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.402468 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.402621 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.402790 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.402937 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.403081 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.403225 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.403404 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.403561 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.403716 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.403862 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.404006 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.404170 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.404318 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.404471 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.404617 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.404772 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.404924 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.405069 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.405213 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.405366 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.405512 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.405664 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.405816 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.405961 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.406122 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.406274 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.406420 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.406564 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.406778 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.406931 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.407090 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.407237 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.407421 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.407579 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.407725 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.407870 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.408028 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.408174 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.408319 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.408319 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.408594 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.408759 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.408914 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.408914 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.409190 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.409341 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.409516 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.409631 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.409723 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.409809 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.409890 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.409979 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.410062 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.410161 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.410245 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.410325 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.410405 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.410484 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.410564 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.410652 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.410765 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.410865 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.411080 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.411180 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.411418 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.411526 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.411738 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.411897 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.412044 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.412190 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.412344 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.412491 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.412654 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.412802 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.412947 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.413099 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.413262 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.413419 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.413563 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.413708 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.413881 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.414048 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.414195 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.414347 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.414494 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.414638 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.414782 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.414941 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.415095 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.415241 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.415447 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.415594 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.415740 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.415900 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.416050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.416231 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.416418 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.416572 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.416862 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.417020 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.417197 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.417446 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.417600 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.417819 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.417981 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.418128 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.418422 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.418576 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.418743 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.418968 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.419118 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.419264 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.419455 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.419603 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.419759 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.419913 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.420061 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.420304 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.420463 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.420618 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.420763 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.420940 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.421095 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.421241 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.421384 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.421557 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.421730 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.421877 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.422022 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.422167 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.422391 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.422544 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.422702 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.422849 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.423062 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.423238 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.423418 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.423563 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.423726 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.423887 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.424041 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.424187 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.424332 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.424476 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.424634 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.424782 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.424927 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.425071 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.425216 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.425374 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.425521 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.425665 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.425821 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.425976 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.426123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.426311 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.426466 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.426634 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.426786 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.426960 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.427113 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.427267 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.427475 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.427620 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.427781 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.427937 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.428162 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.428329 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.428504 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.428655 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.428807 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.428953 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.429106 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.429252 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.429403 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.429549 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.429694 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.429856 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.430011 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.430157 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.430301 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.430452 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.430605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.430751 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.430904 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.431050 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.431195 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.431371 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.431520 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.431666 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.431866 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.432027 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.432142 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.432227 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.432390 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.432531 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.432691 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.432846 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.433003 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.433166 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.433329 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.433489 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.433653 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.433801 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.433956 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.434102 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.434253 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.434407 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.434554 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.434704 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.434851 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.434996 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.435141 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.435330 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.435485 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.435640 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.435823 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.435973 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.436131 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.436278 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.436423 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.436566 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.436716 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.436866 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.437019 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.437173 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.437318 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.437462 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.437625 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.437771 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.437925 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.438078 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.438223 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.438366 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.438511 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.438663 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.438822 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.438975 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.439121 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.439291 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.439447 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.439614 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.439774 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.439928 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.440122 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.440287 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.440434 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.440586 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.440731 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.440876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.441049 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.441202 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.441348 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.441506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.441662 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.441806 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.441956 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.442103 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.442248 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.442521 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.442684 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.442855 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.443005 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.443151 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.443330 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.443483 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.443647 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.443794 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.443937 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.444081 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.444241 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.444387 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.444531 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.444675 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.444818 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.444962 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.445114 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.445262 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.445406 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.445561 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.445706 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.445871 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.446019 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.446163 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.446308 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.446452 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.446597 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.446749 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.446903 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.447060 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.447213 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.447942 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.448106 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.448334 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.449594 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.449933 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.450356 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.450612 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.450850 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.451114 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.451383 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.451383 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.451831 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.451988 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.452192 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.452426 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.452720 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.453068 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.453643 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.453901 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.454227 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.454679 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.454994 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.455328 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.455491 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.455815 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.455994 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.456221 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.456474 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.456725 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.456979 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.457238 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.457396 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.457544 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.457691 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.457838 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.457992 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.458148 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.458315 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.458464 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.458618 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.458774 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.458922 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.459077 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.459224 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.459410 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.459562 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.459719 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.459879 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.460036 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.460184 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.460341 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.460487 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.460632 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.460790 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.460946 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.461092 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.461246 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.461393 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.461540 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.461693 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.461849 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.461996 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.462152 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.462152 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.462439 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.462586 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.462731 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.462876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.463064 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.463768 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.464170 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.464262 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.464262 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.464427 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.464497 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.464563 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.464728 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.464826 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.465034 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.465134 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.465340 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.465430 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.465646 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.465736 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.465951 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.466041 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.466258 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.466361 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.466566 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.466658 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.466874 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.466963 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.467184 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.467315 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.467517 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.467605 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.467823 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.467910 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.468129 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.468230 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.468458 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.468632 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.468782 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.468929 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.469075 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.469235 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.469384 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.469529 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.469682 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.469835 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.469991 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.470137 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.470282 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.470439 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.470585 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.470730 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.470888 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.471035 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.471181 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.471343 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.471495 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.471641 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.471798 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.471951 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.472097 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.472243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.472398 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.472552 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.472710 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.472857 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.473009 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.473154 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.473299 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.473453 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.473607 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.473753 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.473899 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.474050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.474206 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.474364 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.474538 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.474699 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.474846 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.474991 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.475136 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.475322 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.475477 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.475625 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.475805 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.475960 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.476116 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.476274 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.476420 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.476565 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.476712 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.476858 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.477034 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.477190 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.477338 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.477483 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.477651 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.477804 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.477963 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.478121 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.478276 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.478422 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.478567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.478749 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.478898 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.479051 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.479222 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.479646 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.479867 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.480031 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.480179 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.480324 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.480518 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.480682 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.480829 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.480984 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.481131 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.481276 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.481420 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.481566 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.481711 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.481937 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.482095 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.482242 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.482398 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.482544 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.482713 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.482860 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.483006 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:29:55.483150 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.483334 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.483595 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.483926 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.484257 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.484609 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.484927 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.485274 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.485607 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.485931 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.486494 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.486667 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:29:55.486816 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:29:55.547177 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Registered counter for database nova_api May 27 09:29:55.550067 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO dbcounter [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Registered counter for database nova_api May 27 09:29:55.568582 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:29:55.570229 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_db.sqlalchemy.engines [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:29:55.575745 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:29:55.578685 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writer thread running {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:29:55.632696 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.context [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e023520c-85e2-4ea4-af21-7ff61f036f3f(cell1) {{(pid=103241) load_cells /opt/stack/nova/nova/context.py:464}} May 27 09:29:55.636899 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.context [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e023520c-85e2-4ea4-af21-7ff61f036f3f(cell1) {{(pid=103242) load_cells /opt/stack/nova/nova/context.py:464}} May 27 09:29:55.637634 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:29:55.639227 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:29:55.640122 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:29:55.641234 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:29:55.642096 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:29:55.642815 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:29:55.643611 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:29:55.644123 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Registered counter for database nova_cell0 May 27 09:29:55.645568 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:29:55.647698 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO dbcounter [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Registered counter for database nova_cell0 May 27 09:29:55.648072 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Registered counter for database nova_cell1 May 27 09:29:55.651767 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO dbcounter [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Registered counter for database nova_cell1 May 27 09:29:55.655954 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:29:55.657602 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:29:55.659009 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_db.sqlalchemy.engines [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:29:55.663544 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writer thread running {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:29:55.663908 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:29:55.664163 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_db.sqlalchemy.engines [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:29:55.665169 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:29:55.803809 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writer thread running {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:29:55.809122 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Registered counter for database nova_cell0 May 27 09:29:55.813205 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO dbcounter [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Registered counter for database nova_cell0 May 27 09:29:55.817851 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:29:55.821486 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_db.sqlalchemy.engines [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:29:55.822217 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:29:55.826286 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writer thread running {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:29:56.168229 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: WARNING keystonemiddleware.auth_token [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:29:56.168440 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:29:56.175386 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: WARNING keystonemiddleware.auth_token [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:29:56.175676 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:29:56.520574 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:29:56.521257 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: WARNING keystonemiddleware.auth_token [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:29:56.526577 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:29:56.527238 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: WARNING keystonemiddleware.auth_token [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:29:56.531816 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55898fffe9c0 pid: 103241 (default app) May 27 09:29:56.532473 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55898fffe9c0 pid: 103242 (default app) May 27 09:29:56.533858 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:56.535049 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-5f89432c-2d4d-425b-9cbf-3ea3edb65654 None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001736 May 27 09:29:56.535566 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Fri May 27 09:29:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:14.573737 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:14.574934 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 May 27 09:31:14.575633 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 1/2] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:14.586894 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=3 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:14.588058 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell1:SELECT=3 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:14.589157 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell0:SELECT=3 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:14.589986 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:15.025370 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-949b2d94-f3e2-4646-97e1-84aaecfd7904 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:15.056205 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-949b2d94-f3e2-4646-97e1-84aaecfd7904 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.474550 May 27 09:31:15.056991 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 2/3] 10.222.0.41 () {60 vars in 1291 bytes} [Fri May 27 09:31:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:31:17.312985 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:17.314017 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-84e43ccf-984d-4c27-8b50-97aa8182766d None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 27 09:31:17.314426 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 2/4] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:17.375207 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-d46d8e14-b27e-4af8-961d-daea51aedace admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "disk": 1, "swap": 0, "id": "c1"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:17.394985 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:31:17.394985 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: warnings.warn(msg) May 27 09:31:17.423059 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-d46d8e14-b27e-4af8-961d-daea51aedace admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102691 May 27 09:31:17.431116 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 3/5] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 09:31:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:31:17.437998 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writing DB stats nova_api:SELECT=3 {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:17.439005 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writing DB stats nova_cell0:SELECT=3 {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:17.440151 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writing DB stats nova_cell1:SELECT=3 {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:17.440943 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:31:17.644434 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-fe47b316-9028-423e-a612-03bdd76ce56d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:17.646827 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:31:17.646827 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: warnings.warn(msg) May 27 09:31:17.713671 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-fe47b316-9028-423e-a612-03bdd76ce56d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281060 May 27 09:31:17.723449 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 3/6] 10.222.0.41 () {64 vars in 1335 bytes} [Fri May 27 09:31:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:31:19.973577 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-d46d8e14-b27e-4af8-961d-daea51aedace admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:19.975208 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-d46d8e14-b27e-4af8-961d-daea51aedace admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002087 May 27 09:31:19.976651 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 4/7] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:20.093518 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-00912409-eb8f-49ec-9c03-d496370323e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "name": "ds512M"}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:20.111774 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:31:20.111774 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: warnings.warn(msg) May 27 09:31:20.129988 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-00912409-eb8f-49ec-9c03-d496370323e1 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144279 May 27 09:31:20.130710 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 4/8] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 09:31:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:31:20.142774 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-ffec1efd-7e3d-4478-b65b-e84bfc0fd33c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:20.144289 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:31:20.144289 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: warnings.warn(msg) May 27 09:31:20.175108 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-ffec1efd-7e3d-4478-b65b-e84bfc0fd33c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036032 May 27 09:31:20.176036 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 5/9] 10.222.0.41 () {64 vars in 1335 bytes} [Fri May 27 09:31:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:31:22.518307 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-00912409-eb8f-49ec-9c03-d496370323e1 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:22.519487 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-00912409-eb8f-49ec-9c03-d496370323e1 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 27 09:31:22.520088 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 5/10] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:22.586899 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-6f245af3-eb5a-4b33-8343-710be7355af6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds1G", "disk": 10, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:22.608014 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-6f245af3-eb5a-4b33-8343-710be7355af6 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082053 May 27 09:31:22.608615 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 6/11] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 09:31:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:31:22.620293 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-c6294e79-45d4-4834-b6f1-5b259b569b66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:22.643742 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-c6294e79-45d4-4834-b6f1-5b259b569b66 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027067 May 27 09:31:22.644312 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 6/12] 10.222.0.41 () {64 vars in 1335 bytes} [Fri May 27 09:31:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:31:24.933595 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-6f245af3-eb5a-4b33-8343-710be7355af6 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:24.934611 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-6f245af3-eb5a-4b33-8343-710be7355af6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 27 09:31:24.935021 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 7/13] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:24.996394 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-91884152-c6c9-4a89-ba25-d57b78f54ac4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:25.014062 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-91884152-c6c9-4a89-ba25-d57b78f54ac4 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072547 May 27 09:31:25.014616 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 7/14] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 09:31:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:31:25.026813 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-e094fc27-52fa-448c-bb4e-5fdc88d3ee2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:25.051937 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-e094fc27-52fa-448c-bb4e-5fdc88d3ee2a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028758 May 27 09:31:25.052524 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 8/15] 10.222.0.41 () {64 vars in 1335 bytes} [Fri May 27 09:31:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:31:27.305754 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-91884152-c6c9-4a89-ba25-d57b78f54ac4 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:27.306875 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-91884152-c6c9-4a89-ba25-d57b78f54ac4 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 27 09:31:27.307625 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 8/16] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:27.366442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-bca48ee7-5a2a-491d-a214-7aa3485565dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:27.386536 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-bca48ee7-5a2a-491d-a214-7aa3485565dd admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073383 May 27 09:31:27.394305 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 9/17] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 09:31:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:31:27.400000 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-b0fb5801-5871-42af-8aa9-01f036bc3d96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:27.422499 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-b0fb5801-5871-42af-8aa9-01f036bc3d96 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026958 May 27 09:31:27.423051 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 9/18] 10.222.0.41 () {64 vars in 1335 bytes} [Fri May 27 09:31:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:31:29.735993 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-bca48ee7-5a2a-491d-a214-7aa3485565dd admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:29.736996 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-bca48ee7-5a2a-491d-a214-7aa3485565dd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 27 09:31:29.737399 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 10/19] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:29.799762 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-27090ee7-2ffa-46af-afb5-ef71f077f1ae admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:29.823847 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-27090ee7-2ffa-46af-afb5-ef71f077f1ae admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080225 May 27 09:31:29.824585 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 10/20] 10.222.0.41 () {60 vars in 1291 bytes} [Fri May 27 09:31:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:31:32.127939 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-bca48ee7-5a2a-491d-a214-7aa3485565dd admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:32.129236 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-bca48ee7-5a2a-491d-a214-7aa3485565dd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 May 27 09:31:32.129780 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 11/21] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:32.191724 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-76c470b8-5bfc-46ff-9e8d-d1f5cc7829a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "vcpus": 1}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:32.210194 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-76c470b8-5bfc-46ff-9e8d-d1f5cc7829a0 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072830 May 27 09:31:32.211488 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 11/22] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 09:31:32 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 09:31:32.222926 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-31c8534f-c574-41a0-9473-ec0d135dd373 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:32.246305 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-31c8534f-c574-41a0-9473-ec0d135dd373 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026965 May 27 09:31:32.246887 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 12/23] 10.222.0.41 () {64 vars in 1332 bytes} [Fri May 27 09:31:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:31:34.484304 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-76c470b8-5bfc-46ff-9e8d-d1f5cc7829a0 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:34.485165 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-76c470b8-5bfc-46ff-9e8d-d1f5cc7829a0 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 27 09:31:34.485611 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 12/24] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:34.553795 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-ed0a0db4-1644-409e-8c96-9a39f610cd3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "ram": 2048, "vcpus": 1}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:34.572191 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-ed0a0db4-1644-409e-8c96-9a39f610cd3f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080704 May 27 09:31:34.572781 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 13/25] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 09:31:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 09:31:34.584628 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-d538e18a-5b5b-4926-9444-4b3efeade3cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:34.608519 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-d538e18a-5b5b-4926-9444-4b3efeade3cc admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027454 May 27 09:31:34.609143 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 13/26] 10.222.0.41 () {64 vars in 1332 bytes} [Fri May 27 09:31:34 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:31:36.895705 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-ed0a0db4-1644-409e-8c96-9a39f610cd3f admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:36.896822 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-ed0a0db4-1644-409e-8c96-9a39f610cd3f admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 May 27 09:31:36.897299 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 14/27] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:36.968733 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-2cc86462-7185-416b-9757-99c33e2c546d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:36.987161 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-2cc86462-7185-416b-9757-99c33e2c546d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.081350 May 27 09:31:36.987747 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 14/28] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 09:31:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:31:37.000035 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-c5274340-42d3-4093-8d07-bff829062172 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:37.022466 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-c5274340-42d3-4093-8d07-bff829062172 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026155 May 27 09:31:37.023116 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 15/29] 10.222.0.41 () {64 vars in 1332 bytes} [Fri May 27 09:31:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:31:39.262806 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-2cc86462-7185-416b-9757-99c33e2c546d admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:39.263850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-2cc86462-7185-416b-9757-99c33e2c546d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 27 09:31:39.264257 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 15/30] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:39.322486 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-a65735ff-c7f0-43cd-9617-7513e3bdcd69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:39.342130 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-a65735ff-c7f0-43cd-9617-7513e3bdcd69 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072071 May 27 09:31:39.342677 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 16/31] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 09:31:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:31:39.355653 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-af4d893e-f360-4f90-974b-459e30085337 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:39.380568 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-af4d893e-f360-4f90-974b-459e30085337 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029676 May 27 09:31:39.381143 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 16/32] 10.222.0.41 () {64 vars in 1332 bytes} [Fri May 27 09:31:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:31:41.633307 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-a65735ff-c7f0-43cd-9617-7513e3bdcd69 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:31:41.634319 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-a65735ff-c7f0-43cd-9617-7513e3bdcd69 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 27 09:31:41.634723 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 17/33] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:31:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:31:41.741049 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-8a4af9d6-0b69-4d74-9606-0ebb97d3fd3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:41.878936 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-8a4af9d6-0b69-4d74-9606-0ebb97d3fd3e admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.227467 May 27 09:31:41.879538 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 17/34] 10.222.0.41 () {64 vars in 1282 bytes} [Fri May 27 09:31:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:31:41.892100 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-c7ef7257-154f-4c1e-92d6-ccf2f613269a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:31:41.915566 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-c7ef7257-154f-4c1e-92d6-ccf2f613269a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027306 May 27 09:31:41.916126 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 18/35] 10.222.0.41 () {64 vars in 1332 bytes} [Fri May 27 09:31:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:32:06.073401 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-8a4af9d6-0b69-4d74-9606-0ebb97d3fd3e admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:06.074414 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-8a4af9d6-0b69-4d74-9606-0ebb97d3fd3e admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 27 09:32:06.074813 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 18/36] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:32:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:32:06.086107 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:06.137479 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-a74cf711-342a-4c69-a42b-a484bb2602cb admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:06.153895 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-a74cf711-342a-4c69-a42b-a484bb2602cb admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072911 May 27 09:32:06.154430 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 19/37] 10.222.0.41 () {60 vars in 1291 bytes} [Fri May 27 09:32:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:32:07.154692 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-8a4af9d6-0b69-4d74-9606-0ebb97d3fd3e admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:07.155838 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-8a4af9d6-0b69-4d74-9606-0ebb97d3fd3e admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 May 27 09:32:07.156331 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 19/38] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:32:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:32:07.363889 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-64be0741-48f7-4270-b5c0-0ad8efb97881 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:07.369632 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.wsgi [None req-64be0741-48f7-4270-b5c0-0ad8efb97881 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-64be0741-48f7-4270-b5c0-0ad8efb97881 admin admin] Request method failure captured: May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Accept: application/json May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Accept-Encoding: gzip, deflate May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Connection: keep-alive May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Content-Length: 0 May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Host: 10.222.0.41 May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Openstack-Api-Version: compute 2.90 May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Openstack-System-Scope: None May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: User-Agent: python-novaclient May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Auth-Token: gAAAAABikJqXA3Txl3eDJN7sQyb5Dg-j4aRgXl2Zt-PsDPAVPAJ8a3-4j_-sBTVdG8nJ_X7H3fSp3d4fK-VEAXSEEc0jOVrKVbun7ROaNEHCkHx0pqrk16sWwE-rjA2oOh1iHbWmpYjKKPeWRvVSjG_T-nENx9mL7Gmb5mIgV2l8sApJKiJK-j8 May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Domain-Id: None May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Domain-Name: None May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Identity-Status: Confirmed May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Is-Admin-Project: True May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Domain-Id: default May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Domain-Name: Default May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Name: admin May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Role: reader,admin,member May 27 09:32:07.372869 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Roles: reader,admin,member May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ad2dfb9d6b014e38a0011fb0eee6eae7"}]}] May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Tenant: admin May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Tenant-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Tenant-Name: admin May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User: admin May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Domain-Id: default May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Domain-Name: Default May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Id: 0745bfc9958247ec85586308336b6dda May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Name: admin May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: method: > May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: exception: Flavor 42 could not be found. May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: action_args: {'id': '42'} May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:32:07.374506 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:07.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:07.377053 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-64be0741-48f7-4270-b5c0-0ad8efb97881 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:32:07.378107 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-64be0741-48f7-4270-b5c0-0ad8efb97881 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063030 May 27 09:32:07.379250 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 20/39] 10.222.0.41 () {60 vars in 1190 bytes} [Fri May 27 09:32:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:32:07.384638 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-146b3beb-235c-473a-ba14-1aa3e40a42ff admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:07.387675 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:32:07.408231 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-146b3beb-235c-473a-ba14-1aa3e40a42ff admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027666 May 27 09:32:07.408788 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 20/40] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 09:32:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:32:07.419446 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-293ef79f-c645-411e-8c38-d94f151726c9 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:07.442154 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-293ef79f-c645-411e-8c38-d94f151726c9 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026483 May 27 09:32:07.442956 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 21/41] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 09:32:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:32:07.456750 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-218371d3-0e3f-4774-b704-4dbe9f5b297d admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:07.465688 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.wsgi [None req-218371d3-0e3f-4774-b704-4dbe9f5b297d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-218371d3-0e3f-4774-b704-4dbe9f5b297d admin admin] Request method failure captured: May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Accept: application/json May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Accept-Encoding: gzip, deflate May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Connection: keep-alive May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Content-Length: 0 May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Host: 10.222.0.41 May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Openstack-Api-Version: compute 2.90 May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Openstack-System-Scope: None May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: User-Agent: python-novaclient May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Auth-Token: gAAAAABikJqXA3Txl3eDJN7sQyb5Dg-j4aRgXl2Zt-PsDPAVPAJ8a3-4j_-sBTVdG8nJ_X7H3fSp3d4fK-VEAXSEEc0jOVrKVbun7ROaNEHCkHx0pqrk16sWwE-rjA2oOh1iHbWmpYjKKPeWRvVSjG_T-nENx9mL7Gmb5mIgV2l8sApJKiJK-j8 May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Domain-Id: None May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Domain-Name: None May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Identity-Status: Confirmed May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Is-Admin-Project: True May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Domain-Id: default May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Domain-Name: Default May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Name: admin May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Role: reader,admin,member May 27 09:32:07.469123 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Roles: reader,admin,member May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ad2dfb9d6b014e38a0011fb0eee6eae7"}]}] May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Tenant: admin May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Tenant-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Tenant-Name: admin May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User: admin May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Domain-Id: default May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Domain-Name: Default May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Id: 0745bfc9958247ec85586308336b6dda May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Name: admin May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: method: > May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: exception: Flavor 42 could not be found. May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: action_args: {'id': '42'} May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:32:07.472482 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:07.473260 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:07.474272 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-218371d3-0e3f-4774-b704-4dbe9f5b297d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:32:07.475652 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-218371d3-0e3f-4774-b704-4dbe9f5b297d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.021215 May 27 09:32:07.475652 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 21/42] 10.222.0.41 () {60 vars in 1190 bytes} [Fri May 27 09:32:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:32:08.391229 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-293ef79f-c645-411e-8c38-d94f151726c9 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:08.392249 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-293ef79f-c645-411e-8c38-d94f151726c9 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 27 09:32:08.392645 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 22/43] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:32:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:32:08.601731 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-6b764241-afa2-4675-ae9a-14abc7347a56 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:08.608325 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.wsgi [None req-6b764241-afa2-4675-ae9a-14abc7347a56 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-6b764241-afa2-4675-ae9a-14abc7347a56 admin admin] Request method failure captured: May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Accept: application/json May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Accept-Encoding: gzip, deflate May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Connection: keep-alive May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Content-Length: 0 May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Host: 10.222.0.41 May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Openstack-Api-Version: compute 2.90 May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Openstack-System-Scope: None May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: User-Agent: python-novaclient May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Auth-Token: gAAAAABikJqYoXiwLRe2uTuomfdGVcrSWVdIENCIyZ2WTJYF317EI7vxcaq6ZgGW793WKZ1E9AZf7S8n1Cpl1roKYfjGbSEQdvqiEyqVTSDdDrvJYkPecHe8Z8oFNU--RsGwzN57RJmH75AokoXxuBsGMhLCStuo5MwlaTAOU18eO9BgA5XS2vM May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Domain-Id: None May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Domain-Name: None May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Identity-Status: Confirmed May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Is-Admin-Project: True May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Domain-Id: default May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Domain-Name: Default May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Name: admin May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Role: reader,admin,member May 27 09:32:08.609853 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Roles: reader,admin,member May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ad2dfb9d6b014e38a0011fb0eee6eae7"}]}] May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Tenant: admin May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Tenant-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Tenant-Name: admin May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User: admin May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Domain-Id: default May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Domain-Name: Default May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Id: 0745bfc9958247ec85586308336b6dda May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Name: admin May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: method: > May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: exception: Flavor 84 could not be found. May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: action_args: {'id': '84'} May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:32:08.611442 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:08.612314 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:08.613429 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-6b764241-afa2-4675-ae9a-14abc7347a56 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:32:08.614462 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-6b764241-afa2-4675-ae9a-14abc7347a56 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.066797 May 27 09:32:08.614462 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 22/44] 10.222.0.41 () {60 vars in 1190 bytes} [Fri May 27 09:32:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:32:08.621675 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-3a4b6836-4111-47d6-8156-143d3d96c095 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:08.637829 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-3a4b6836-4111-47d6-8156-143d3d96c095 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019699 May 27 09:32:08.638477 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 23/45] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 09:32:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:32:08.648369 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-dcb0ae5b-0149-4abd-a8df-b5859d2c6f92 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:08.664108 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-dcb0ae5b-0149-4abd-a8df-b5859d2c6f92 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019390 May 27 09:32:08.664671 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 23/46] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 09:32:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:32:08.674059 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-309e6065-6a77-4390-9467-026287a2b678 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:08.681063 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.wsgi [None req-309e6065-6a77-4390-9467-026287a2b678 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-309e6065-6a77-4390-9467-026287a2b678 admin admin] Request method failure captured: May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Accept: application/json May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Accept-Encoding: gzip, deflate May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Connection: keep-alive May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Content-Length: 0 May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Host: 10.222.0.41 May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Openstack-Api-Version: compute 2.90 May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Openstack-System-Scope: None May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: User-Agent: python-novaclient May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Auth-Token: gAAAAABikJqYoXiwLRe2uTuomfdGVcrSWVdIENCIyZ2WTJYF317EI7vxcaq6ZgGW793WKZ1E9AZf7S8n1Cpl1roKYfjGbSEQdvqiEyqVTSDdDrvJYkPecHe8Z8oFNU--RsGwzN57RJmH75AokoXxuBsGMhLCStuo5MwlaTAOU18eO9BgA5XS2vM May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Domain-Id: None May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Domain-Name: None May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Identity-Status: Confirmed May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Is-Admin-Project: True May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Domain-Id: default May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Domain-Name: Default May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Name: admin May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Role: reader,admin,member May 27 09:32:08.682605 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Roles: reader,admin,member May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ad2dfb9d6b014e38a0011fb0eee6eae7"}]}] May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Tenant: admin May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Tenant-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Tenant-Name: admin May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User: admin May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Domain-Id: default May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Domain-Name: Default May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Id: 0745bfc9958247ec85586308336b6dda May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Name: admin May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: method: > May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: exception: Flavor 84 could not be found. May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: action_args: {'id': '84'} May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:32:08.684050 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:08.684987 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:08.686442 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-309e6065-6a77-4390-9467-026287a2b678 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:32:08.687432 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-309e6065-6a77-4390-9467-026287a2b678 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013517 May 27 09:32:08.687432 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 24/47] 10.222.0.41 () {60 vars in 1190 bytes} [Fri May 27 09:32:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:32:09.566522 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-dcb0ae5b-0149-4abd-a8df-b5859d2c6f92 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:09.567588 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-dcb0ae5b-0149-4abd-a8df-b5859d2c6f92 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 27 09:32:09.567980 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 24/48] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:32:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:32:09.761405 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1014625e-6b16-4f6d-8dbf-2fb997650d74 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:09.768375 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.wsgi [None req-1014625e-6b16-4f6d-8dbf-2fb997650d74 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1014625e-6b16-4f6d-8dbf-2fb997650d74 admin admin] Request method failure captured: May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Accept: application/json May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Accept-Encoding: gzip, deflate May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Connection: keep-alive May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Content-Length: 0 May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Host: 10.222.0.41 May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Openstack-Api-Version: compute 2.90 May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Openstack-System-Scope: None May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: User-Agent: python-novaclient May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Auth-Token: gAAAAABikJqZXvPPZcyIZeLYmY1AiBddcFoQG9VJ22MHtThljbyihl1mUhI-XQb5OcmJRsi9bjynJNPBGwKVKAZr3v3a5XncSdtbDUJsnNkDqY21-BUeF9uoa0PIjFnPHNtZ5sPZgQfCy-av7hJtCQlAiFBWRMz8h9kJ6hWwoGEGHoQHQJdw_ow May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Domain-Id: None May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Domain-Name: None May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Identity-Status: Confirmed May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Is-Admin-Project: True May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Domain-Id: default May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Domain-Name: Default May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Project-Name: admin May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Role: reader,admin,member May 27 09:32:09.769876 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Roles: reader,admin,member May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ad2dfb9d6b014e38a0011fb0eee6eae7"}]}] May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Tenant: admin May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Tenant-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-Tenant-Name: admin May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User: admin May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Domain-Id: default May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Domain-Name: Default May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Id: 0745bfc9958247ec85586308336b6dda May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: X-User-Name: admin May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: method: > May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: exception: Flavor 451 could not be found. May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: action_args: {'id': '451'} May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:32:09.771243 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:09.772090 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi May 27 09:32:09.773275 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1014625e-6b16-4f6d-8dbf-2fb997650d74 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:32:09.774429 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-1014625e-6b16-4f6d-8dbf-2fb997650d74 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063711 May 27 09:32:09.774429 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 25/49] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 09:32:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:32:09.781137 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-8f1f6a3d-0997-486f-afed-21987c2736a0 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:09.795685 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-8f1f6a3d-0997-486f-afed-21987c2736a0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017996 May 27 09:32:09.796536 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 25/50] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 09:32:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:32:09.806344 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:09.820598 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018353 May 27 09:32:09.821140 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 26/51] 10.222.0.41 () {60 vars in 1210 bytes} [Fri May 27 09:32:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:32:09.830399 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-a040c317-e005-44d2-88d5-3334aa0796c8 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:09.836369 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.wsgi [None req-a040c317-e005-44d2-88d5-3334aa0796c8 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-a040c317-e005-44d2-88d5-3334aa0796c8 admin admin] Request method failure captured: May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Accept: application/json May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Accept-Encoding: gzip, deflate May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Connection: keep-alive May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Content-Length: 0 May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Host: 10.222.0.41 May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Openstack-Api-Version: compute 2.90 May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Openstack-System-Scope: None May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: User-Agent: python-novaclient May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Auth-Token: gAAAAABikJqZXvPPZcyIZeLYmY1AiBddcFoQG9VJ22MHtThljbyihl1mUhI-XQb5OcmJRsi9bjynJNPBGwKVKAZr3v3a5XncSdtbDUJsnNkDqY21-BUeF9uoa0PIjFnPHNtZ5sPZgQfCy-av7hJtCQlAiFBWRMz8h9kJ6hWwoGEGHoQHQJdw_ow May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Domain-Id: None May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Domain-Name: None May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Identity-Status: Confirmed May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Is-Admin-Project: True May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Domain-Id: default May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Domain-Name: Default May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Project-Name: admin May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Role: reader,admin,member May 27 09:32:09.837850 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Roles: reader,admin,member May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ad2dfb9d6b014e38a0011fb0eee6eae7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ad2dfb9d6b014e38a0011fb0eee6eae7"}]}] May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Tenant: admin May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Tenant-Id: ad2dfb9d6b014e38a0011fb0eee6eae7 May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-Tenant-Name: admin May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User: admin May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Domain-Id: default May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Domain-Name: Default May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Id: 0745bfc9958247ec85586308336b6dda May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: X-User-Name: admin May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: method: > May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: exception: Flavor 451 could not be found. May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: action_args: {'id': '451'} May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:32:09.839247 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:09.840189 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: ERROR nova.api.openstack.wsgi May 27 09:32:09.841277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-a040c317-e005-44d2-88d5-3334aa0796c8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:32:09.842545 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-a040c317-e005-44d2-88d5-3334aa0796c8 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012251 May 27 09:32:09.842545 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 26/52] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 09:32:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:32:10.712353 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:10.713349 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 27 09:32:10.713743 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 27/53] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:32:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:32:10.902632 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-147bdc8c-d8a7-4471-a9ba-cecdc4ae02fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:32:10.922027 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-147bdc8c-d8a7-4471-a9ba-cecdc4ae02fd admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072913 May 27 09:32:10.922518 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 27/54] 10.222.0.41 () {64 vars in 1235 bytes} [Fri May 27 09:32:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:32:11.789982 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:11.791056 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 27 09:32:11.791606 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 28/55] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:32:11.983552 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-4e2d8904-b0b1-4959-a84c-49a6fc6986e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:32:12.001709 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-4e2d8904-b0b1-4959-a84c-49a6fc6986e2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073673 May 27 09:32:12.002201 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 28/56] 10.222.0.41 () {64 vars in 1235 bytes} [Fri May 27 09:32:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:32:12.879205 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:12.880236 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 27 09:32:12.880640 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 29/57] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:32:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:32:13.069232 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-4dac9bb8-7e19-4ddd-99c4-b5043379e378 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:32:13.086909 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-4dac9bb8-7e19-4ddd-99c4-b5043379e378 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069913 May 27 09:32:13.087425 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 29/58] 10.222.0.41 () {64 vars in 1235 bytes} [Fri May 27 09:32:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:32:14.010569 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:14.011619 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 27 09:32:14.012150 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 30/59] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:32:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:32:14.202806 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-41c292eb-3f85-414a-8a76-ebcecf8f230b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:32:14.221282 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-41c292eb-3f85-414a-8a76-ebcecf8f230b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069684 May 27 09:32:14.221769 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 30/60] 10.222.0.41 () {64 vars in 1235 bytes} [Fri May 27 09:32:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:32:15.122109 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:15.123105 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 27 09:32:15.123528 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 31/61] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:32:15.308703 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-364c67a9-0b1b-4370-83c5-0301ee72af4c admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:32:15.329565 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-364c67a9-0b1b-4370-83c5-0301ee72af4c admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071257 May 27 09:32:15.330283 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 31/62] 10.222.0.41 () {60 vars in 1202 bytes} [Fri May 27 09:32:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:33:16.904488 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:33:16.905541 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-1cdb6c71-05bf-4220-a826-2da5dbb6d90d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 27 09:33:16.905938 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 32/63] 10.222.0.41 () {54 vars in 930 bytes} [Fri May 27 09:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:33:16.913879 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:33:16.965088 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-900f1a35-c000-4183-b4e6-433d88b86508 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:33:16.985054 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-900f1a35-c000-4183-b4e6-433d88b86508 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073242 May 27 09:33:16.985586 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 32/64] 10.222.0.41 () {60 vars in 1291 bytes} [Fri May 27 09:33:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:33:17.006494 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=14 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:33:17.010387 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-f6122bc9-8a8e-4d08-aa1f-6e16ff1a0443 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:33:17.017933 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-f6122bc9-8a8e-4d08-aa1f-6e16ff1a0443 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013469 May 27 09:33:17.018449 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 33/65] 10.222.0.41 () {60 vars in 1282 bytes} [Fri May 27 09:33:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:33:17.030276 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-c2850124-5eff-42e7-8953-446c1e41feb7 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:33:17.038125 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-c2850124-5eff-42e7-8953-446c1e41feb7 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011301 May 27 09:33:17.038648 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 33/66] 10.222.0.41 () {60 vars in 1285 bytes} [Fri May 27 09:33:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:33:17.049820 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-51a35648-a2ad-4979-a2d0-e28b43726bae admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:33:17.057659 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-51a35648-a2ad-4979-a2d0-e28b43726bae admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011339 May 27 09:33:17.058165 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 34/67] 10.222.0.41 () {60 vars in 1285 bytes} [Fri May 27 09:33:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:33:17.071088 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-3d773f8f-33f4-473f-b5ef-1f82af0c4972 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:33:17.078678 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-3d773f8f-33f4-473f-b5ef-1f82af0c4972 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011543 May 27 09:33:17.079196 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 34/68] 10.222.0.41 () {60 vars in 1282 bytes} [Fri May 27 09:33:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:46.260237 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-51a35648-a2ad-4979-a2d0-e28b43726bae admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:46.261241 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-51a35648-a2ad-4979-a2d0-e28b43726bae admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 27 09:36:46.261639 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 35/69] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:46.431427 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writing DB stats nova_api:SELECT=6 {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:46.543337 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-7057535a-30a7-4302-af95-6e22e77c2d85 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:46.544507 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:46.544507 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: warnings.warn(msg) May 27 09:36:46.545762 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-7057535a-30a7-4302-af95-6e22e77c2d85 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:46.546191 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-7057535a-30a7-4302-af95-6e22e77c2d85 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:46.546957 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-7057535a-30a7-4302-af95-6e22e77c2d85 admin admin] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:46.547405 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-7057535a-30a7-4302-af95-6e22e77c2d85 admin admin] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:46.581733 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-7057535a-30a7-4302-af95-6e22e77c2d85 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.151728 May 27 09:36:46.582277 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 35/70] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 09:36:46 2022] GET /compute/v2.1/os-services => generated 794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:36:47.448504 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-51a35648-a2ad-4979-a2d0-e28b43726bae admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:47.449547 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-51a35648-a2ad-4979-a2d0-e28b43726bae admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 27 09:36:47.449943 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 36/71] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:36:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:47.637625 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-e3ca250b-8343-46a3-9218-6f57406d3ee4 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:47.638802 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:47.638802 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: warnings.warn(msg) May 27 09:36:47.640010 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-e3ca250b-8343-46a3-9218-6f57406d3ee4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:47.640446 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-e3ca250b-8343-46a3-9218-6f57406d3ee4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:47.641217 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-e3ca250b-8343-46a3-9218-6f57406d3ee4 admin admin] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:47.641639 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-e3ca250b-8343-46a3-9218-6f57406d3ee4 admin admin] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:47.666545 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-e3ca250b-8343-46a3-9218-6f57406d3ee4 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080360 May 27 09:36:47.667035 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 36/72] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 09:36:47 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:36:58.947630 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-51a35648-a2ad-4979-a2d0-e28b43726bae admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:58.948637 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-51a35648-a2ad-4979-a2d0-e28b43726bae admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 27 09:36:58.949028 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 37/73] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:36:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:36:59.089312 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writing DB stats nova_cell0:SELECT=4 {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:59.090024 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writing DB stats nova_cell1:SELECT=4 {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:59.090618 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG dbcounter [-] [103242] Writing DB stats nova_api:SELECT=8 {{(pid=103242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:59.137614 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-a712bb7c-cff6-42fe-8efd-7d9bfa6f6bdf admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:59.138769 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:36:59.138769 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: warnings.warn(msg) May 27 09:36:59.139976 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-a712bb7c-cff6-42fe-8efd-7d9bfa6f6bdf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:59.140415 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-a712bb7c-cff6-42fe-8efd-7d9bfa6f6bdf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:59.141193 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-a712bb7c-cff6-42fe-8efd-7d9bfa6f6bdf admin admin] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:59.141624 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-a712bb7c-cff6-42fe-8efd-7d9bfa6f6bdf admin admin] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:59.166357 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-a712bb7c-cff6-42fe-8efd-7d9bfa6f6bdf admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.081378 May 27 09:36:59.166839 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 37/74] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 09:36:59 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:00.034493 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-51a35648-a2ad-4979-a2d0-e28b43726bae admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:00.035520 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-51a35648-a2ad-4979-a2d0-e28b43726bae admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 27 09:37:00.035928 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 38/75] 10.222.0.41 () {56 vars in 1074 bytes} [Fri May 27 09:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:37:00.224559 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG nova.api.openstack.wsgi [None req-b38a7b44-55c2-487f-b7b5-816d78574f69 admin admin] Calling method '>' {{(pid=103242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:00.225723 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:37:00.225723 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: warnings.warn(msg) May 27 09:37:00.227168 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-b38a7b44-55c2-487f-b7b5-816d78574f69 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:00.227641 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-b38a7b44-55c2-487f-b7b5-816d78574f69 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:00.228426 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-b38a7b44-55c2-487f-b7b5-816d78574f69 admin admin] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:00.228896 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: DEBUG oslo_concurrency.lockutils [None req-b38a7b44-55c2-487f-b7b5-816d78574f69 admin admin] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:00.249981 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: INFO nova.api.openstack.requestlog [None req-b38a7b44-55c2-487f-b7b5-816d78574f69 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.076081 May 27 09:37:00.250465 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: [pid: 103242|app: 0|req: 38/76] 10.222.0.41 () {60 vars in 1193 bytes} [Fri May 27 09:37:00 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:38:00.300265 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: Fri May 27 09:38:00 2022 - graceful shutdown triggered... May 27 09:38:00.300394 dv-cinder-797608-21-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 27 09:38:00.301310 dv-cinder-797608-21-iscsi devstack@n-api.service[103242]: Gracefully killing worker 2 (pid: 103242)... May 27 09:38:00.302264 dv-cinder-797608-21-iscsi devstack@n-api.service[103241]: Gracefully killing worker 1 (pid: 103241)... May 27 09:38:01.302377 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: worker 1 buried after 1 seconds May 27 09:38:01.302377 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: worker 2 buried after 1 seconds May 27 09:38:01.302377 dv-cinder-797608-21-iscsi devstack@n-api.service[103240]: goodbye to uWSGI. May 27 09:38:01.303983 dv-cinder-797608-21-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 27 09:38:01.304542 dv-cinder-797608-21-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 27 09:38:01.307268 dv-cinder-797608-21-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 09:38:01.324740 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 09:38:01.337239 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 09:38:01 2022] *** May 27 09:38:01.337239 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 09:38:01.337239 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 09:38:01.337239 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: nodename: dv-cinder-797608-21-iscsi May 27 09:38:01.337239 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: machine: x86_64 May 27 09:38:01.337239 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: clock source: unix May 27 09:38:01.337239 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: pcre jit disabled May 27 09:38:01.337239 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: detected number of CPU cores: 4 May 27 09:38:01.337239 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: current working directory: / May 27 09:38:01.337239 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: detected binary path: /usr/bin/uwsgi-core May 27 09:38:01.338022 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: your processes number limit is 47680 May 27 09:38:01.338022 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: your memory page size is 4096 bytes May 27 09:38:01.338022 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: detected max file descriptor number: 2048 May 27 09:38:01.338022 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: lock engine: pthread robust mutexes May 27 09:38:01.338022 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: thunder lock: enabled May 27 09:38:01.338022 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 09:38:01.338022 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 09:38:01.383730 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: Python main interpreter initialized at 0x55fdfe7e79c0 May 27 09:38:01.383730 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: python threads support enabled May 27 09:38:01.383730 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: your server socket listen backlog is limited to 100 connections May 27 09:38:01.383730 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: your mercy for graceful operations on workers is 90 seconds May 27 09:38:01.384165 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: mapped 403077 bytes (393 KB) for 2 cores May 27 09:38:01.384165 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: *** Operational MODE: preforking *** May 27 09:38:01.384426 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: *** uWSGI is running in multiple interpreter mode *** May 27 09:38:01.384426 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: spawned uWSGI master process (pid: 129276) May 27 09:38:01.384632 dv-cinder-797608-21-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 09:38:01.385817 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: spawned uWSGI worker 1 (pid: 129290, cores: 1) May 27 09:38:01.385817 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: spawned uWSGI worker 2 (pid: 129291, cores: 1) May 27 09:38:01.385817 dv-cinder-797608-21-iscsi devstack@n-api.service[129276]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 09:38:02.577139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 09:38:02.584678 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 09:38:03.398685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:38:03.398685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: from cryptography.utils import int_from_bytes May 27 09:38:03.398970 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:38:03.398970 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: from cryptography.utils import int_from_bytes May 27 09:38:03.447746 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:38:03.447746 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: from cryptography.utils import int_from_bytes May 27 09:38:03.448142 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:38:03.448142 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: from cryptography.utils import int_from_bytes May 27 09:38:05.862884 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:38:05.863451 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:38:05.864327 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:38:05.864619 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:38:05.864897 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:38:05.865275 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.865605 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.865938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.866266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.866601 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.866916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.867385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.867591 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.867930 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.868190 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.868510 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.868838 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-21-iscsi {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.869162 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.869478 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.869791 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.870113 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.870422 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.870749 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.871054 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.871581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.872034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.872348 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.872666 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.873005 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.873320 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.873634 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.873955 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.874267 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.874594 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.874920 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.875338 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-21-iscsi {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.875663 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.875986 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.876319 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.876722 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.877034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.877348 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.877672 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.877993 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.878303 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.878630 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.878951 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.879960 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.880156 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.880461 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.880771 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.881081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.881401 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.881710 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.882017 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.882270 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.882583 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.882906 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.883225 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.883581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.883841 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.884093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.884415 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.884737 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.885051 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.885487 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.885673 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.885987 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.886296 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.886607 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.886915 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.887228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.887572 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.887889 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.888211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.888520 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.888841 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.889238 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.889494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.889494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.889494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.889494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.889494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.889494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.889494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.889494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.893434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.893434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.893434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.893434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.893434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.893434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.893834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.894142 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.894307 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.894614 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.894924 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.895259 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.895585 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.895900 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.896209 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.896518 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.896827 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.897133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.897441 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.897750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.898058 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.898365 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.898683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.899002 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.899329 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.899643 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.899953 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.900263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.900585 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.900895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.901204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.901527 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.901839 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.902151 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.902472 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.902783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.903092 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.903437 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.903742 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.904054 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.904372 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.904681 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.904988 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.905292 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.905599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.905910 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.906217 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.906522 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.906828 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.907132 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.907480 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.907952 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.908451 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.908769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.909082 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.909406 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.909748 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.910081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.910427 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.910774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.911111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.911475 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.911798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.912115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.912434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.912763 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.913085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.913394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.913706 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.914028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.914350 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.914693 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.915002 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.915348 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.915676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.915999 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.916320 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.916652 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.916980 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.917291 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.917636 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.917983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.918301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.918630 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.918961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.919293 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.919617 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.919933 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.920263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.920604 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.920918 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.921242 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.921566 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.921873 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.922190 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.922506 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.922838 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.923164 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.923523 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.923841 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.924158 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.924484 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.924798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.925115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.925429 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.925740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.926112 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.926904 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.927222 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.927557 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.927888 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.928210 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.928522 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.928857 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.929170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.929485 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.929799 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.930114 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.930976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.930976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.931307 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.931460 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.931705 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.931981 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.932292 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.932618 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.932927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.933232 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.933550 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.933865 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.934177 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.934346 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:38:05.934860 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.935018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:38:05.935195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.935527 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:38:05.935701 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.935701 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.936000 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:38:05.936000 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:38:05.936376 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.936376 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.936682 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.936841 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.936994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.937150 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.937301 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.937460 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.937607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.937752 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.937903 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.938056 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.938210 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.938356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.938509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.938664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.938818 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.938963 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.939117 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.939263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.939446 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.939605 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.939752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.939904 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.940062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-21-iscsi {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.940216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.940368 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.940613 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.940784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.940939 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.940939 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.941340 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.941494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.941647 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.942592 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.942775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.942962 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.943132 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.943307 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.943472 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.943620 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.943790 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.943959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.944106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.944266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.944413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.944579 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.944737 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.944885 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.945030 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.945184 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.945341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.945695 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.945861 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.946016 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.946163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.946316 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.946558 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.946728 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.946874 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.947028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.947175 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.947360 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.947526 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-21-iscsi {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.947775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.947946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.948102 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.948248 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.948400 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.948559 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.948751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.948751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.949028 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.949184 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.949343 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.949497 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.949650 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.949804 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.949966 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.950120 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.950277 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.950423 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.950678 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.950844 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.951002 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.951176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.951443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.951608 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.951768 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.951916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.952071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.952226 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.952373 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.952536 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.952774 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.952774 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.953068 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.953068 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.953344 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.953501 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.953655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.953655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.953932 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.954094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.954255 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.954410 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.954556 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.954708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.954854 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.955005 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.955164 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.955336 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.955503 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.955832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.955988 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.956156 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.956389 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.956566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.956785 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.956945 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.957101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.957261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.957423 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.957616 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.957772 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.957926 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.958073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.958275 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.958432 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.958587 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.958741 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.958888 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.959041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.959202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.959429 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.959578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.959733 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.959887 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.960042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.960201 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.960368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.960555 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.960725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.961009 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.961184 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.961332 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.961589 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.961752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.961908 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.962062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.962223 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.962377 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.962537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.962699 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.962935 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.963097 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.963254 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.963437 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.963586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.963743 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.963891 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.964037 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.964197 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.964351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.964644 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.964833 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.965005 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.965174 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.965328 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.965473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.965626 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.965978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.966134 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.966289 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.966445 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.966591 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.966736 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.966986 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.967157 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.967360 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.967523 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.967670 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.967823 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.967968 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.968114 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.968271 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.968425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.968584 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.968738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.968883 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.969043 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.969201 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.969355 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.969509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.969509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.969788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.969942 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.970095 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.970242 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.970387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.970539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.970684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.970843 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.971086 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.971250 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.971430 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.971597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.971841 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.972006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.972154 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.972299 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.972453 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.972617 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.972781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.972946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.973710 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.973866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.974029 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.974190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.974347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.974493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.974638 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.974791 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.975205 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.975378 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.975527 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.975682 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.975864 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.976183 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.976348 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.976496 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.976650 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.976803 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.976803 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.977193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.977357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.977506 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.977652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.977798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.977798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.978087 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.978233 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.978389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.978389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.978669 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.978829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.978976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.979121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.979318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.979473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.979620 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.979779 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.979944 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.980100 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.980246 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.980415 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.980562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.980708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.980861 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.981008 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.981256 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.981410 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.981567 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.981730 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.981993 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.982147 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.982304 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.982450 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.982633 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.982790 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.982937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.983099 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.983261 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.983446 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:38:05.983594 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.983839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.983994 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.984148 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.984308 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.984454 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.984618 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.984618 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.984903 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.985058 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.985212 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.985361 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.985513 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.985668 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.985821 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.986055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.986399 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.986562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.986709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.986875 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.987023 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.987203 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.987493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.987644 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.987797 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.987797 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.988079 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.988079 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.988372 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.988372 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.988657 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.989367 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.989535 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.989535 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.989829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.989975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.990121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.990266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.990424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.990578 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.990722 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.990876 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.991021 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.991168 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.991445 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.991602 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.991755 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.991901 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.992149 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.992318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.992473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.992627 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.992780 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.992934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.993106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.994013 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.994182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.994353 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.994507 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.994655 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.994801 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.994957 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.995110 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.995264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.995472 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.995631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.995778 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.995933 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.996080 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.996226 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.996562 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.996725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.996871 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.997032 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.997187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.997334 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.997500 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.997719 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.997719 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.998018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.998166 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.998311 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.998458 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.998621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.998782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.998935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.999082 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.999236 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.999406 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.999554 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.999717 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:05.999870 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.000017 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.000162 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.000318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.000476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.000637 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.000790 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.000937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.001082 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.001234 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.001406 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.001628 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.001788 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.001934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.002080 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.002326 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.002496 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.002663 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.002817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.002963 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.003127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.003300 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.003471 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.003620 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.003772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.003919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.004155 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.004339 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.004508 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.004672 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.004839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.004998 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.005151 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.005311 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.005465 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.005612 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.008643 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.008815 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.008972 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.009140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.009298 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.009447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.009600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.009768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.009924 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.010082 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.010239 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.010394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.010548 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.010702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.010857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.011035 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.011953 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.012115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.012275 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.012560 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.012729 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.012889 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.013042 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.013201 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.013348 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.013494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.013654 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.013802 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.013947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.014092 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.014341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.014501 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.014668 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.014822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.014968 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.015113 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.015257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.015440 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.015600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.015746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.015899 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.016053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.016198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.016367 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.016569 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.016738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.016884 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.017036 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.017187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.017356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.017509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.017661 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.017820 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.017973 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.018124 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.018539 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.018710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.018864 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.019027 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.019194 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.019385 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.019544 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.019704 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.019857 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.020053 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.020217 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.020385 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.020548 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.020701 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.020853 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.021012 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.021176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.021342 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.021498 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.021657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.021908 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.022069 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.022221 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.022383 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.022556 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.022796 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.022955 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.023127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.023559 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.023733 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.023896 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.024048 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.024209 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.024453 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.024696 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.024854 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.025007 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.025166 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.025328 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.025487 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.025650 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.025818 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.025971 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.026131 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.026292 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.026444 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.026610 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.026765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.026924 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.027076 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.027236 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.027427 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.027590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.027750 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.027941 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.028197 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.028394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.028847 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.029004 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.029156 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.029398 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.029570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.029733 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.029902 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.030055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.030214 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.030374 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.030539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.030691 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.030856 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.031020 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.031180 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.031351 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.031509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.031672 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.031837 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.032095 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.032264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.032426 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.032590 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.032892 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.033157 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.033327 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.033482 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.033653 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.033920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.034112 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.034269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.034446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.034673 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.034833 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.034985 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.035161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.035343 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.035513 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.036203 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.036365 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.036518 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.036685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.036846 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.037006 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.037165 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.037334 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.037508 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.037662 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.037825 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.037985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.038145 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.038300 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.038464 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.038881 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.039044 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.039206 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.039420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.039576 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.039740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.039902 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.040061 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.040227 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.040381 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.040532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.040692 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.040845 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.040998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.041158 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.041310 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.041477 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.041630 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.041781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.041940 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.042129 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.042363 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.042537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.042703 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.042857 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.043015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.043185 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.043455 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.043455 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.043782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.043936 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.044096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.044255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.044418 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.044580 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.044824 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.044984 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.045137 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.045288 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.045450 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.045603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.045756 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.045756 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.046050 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.046050 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.046050 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.046050 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.046050 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.046783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.046940 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.047093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.047332 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.047502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.047664 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.047820 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.047971 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.048131 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.048298 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.048452 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.048621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.049107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.049280 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.049451 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.049612 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.049774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.049928 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.050087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.050239 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.050403 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.050556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.050556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.050914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.051068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.051304 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.051490 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.051648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.051808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.051971 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.052132 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.052285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.052550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.052712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.052864 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.053024 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.053197 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.053360 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.053621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.053781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.053946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.054111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.054264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.054426 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.054579 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.054739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.054976 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.055137 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.055367 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.055561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.055561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.055861 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.056014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.056174 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.056326 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.056491 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.056653 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.056806 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.056958 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.057116 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.057286 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.057458 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.057620 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.057773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.057931 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.058083 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.058250 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.058403 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.058554 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.058714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.058880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.059287 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.059455 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.059610 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.059786 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.059959 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.060121 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.060274 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.060435 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.060626 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.060785 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.060946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.061100 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.061251 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.061412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.061571 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.061725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.061901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.062063 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.062223 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.062376 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.062376 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.062376 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.062376 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.063051 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.063205 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.063411 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.063578 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.063924 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.064094 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.064269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.064432 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.064594 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.064757 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.065008 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.065253 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.065422 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.065578 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.065739 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.065901 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.066063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.066217 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.066377 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.066550 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.066711 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.067434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.067613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.067773 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.067941 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.068689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.068854 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.069025 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.069446 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.070999 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.071190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.071449 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.071628 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.071787 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.071941 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.072093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.072244 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.072405 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.072573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.072763 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.073013 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.073013 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.073330 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.073504 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.073675 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.073854 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.074120 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.074290 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.074443 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.074606 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.074768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.074928 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.075090 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.075262 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.075515 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.075687 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.075857 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.076019 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.076188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.076188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.076487 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.076649 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.076801 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.076953 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.077106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.077272 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.077435 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.077599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.077763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.077923 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.078076 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.078238 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.078400 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.078561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.078714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.078868 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.079026 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.079026 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.079595 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.079767 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.079932 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.080099 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.080268 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.080428 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.080582 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.080741 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.080902 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.081055 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.081217 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.081371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.081524 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.081683 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.081838 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.082006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.082169 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.082323 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.082535 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.082707 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.082872 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.083055 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.083336 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.083336 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.083638 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.083792 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.083943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.084151 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.084394 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.084394 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.084703 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.084864 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.085026 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.085194 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.085347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.085520 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.085742 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.085908 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.086071 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.086224 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.086224 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.086536 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.086536 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.086843 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.087005 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.087159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.087329 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.087501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.087657 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.087817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.087984 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.088138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.088291 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.088463 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.088627 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.088787 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.088953 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.089106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.089259 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.089410 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.089810 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.090054 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.090220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.090382 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.090543 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.090699 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.090870 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.091033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.091187 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.091360 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.091528 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.091681 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.091835 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.092002 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.092164 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.092324 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.092324 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.092629 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.093367 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.093605 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.093765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.093931 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.094096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.094250 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.094767 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.094952 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.095116 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.095363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.095534 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.095716 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.095947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.096115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.096277 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.096441 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.096594 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.096755 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.096908 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.097070 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.097237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.097398 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.097558 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.097713 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.097876 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.098038 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.098734 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.098891 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.099052 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.099214 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.099214 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.099568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.100791 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.100967 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.101124 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.101286 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.101286 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.101607 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.101780 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.101944 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.102107 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.102263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.102424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.102588 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.102742 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.102895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.102895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.103184 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.103372 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.103542 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.103825 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.103986 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.104140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.104299 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.104461 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.104627 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.104807 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.105065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.105224 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.105378 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.105532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.105693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.105866 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.106107 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.106497 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.106611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.106716 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.106812 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.106812 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.106986 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.107081 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.107175 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.107270 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.107453 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.107598 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.107899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.107899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.108156 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.108299 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.108441 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.108612 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.108703 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.108949 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.109048 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.109150 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.109238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.109325 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.109410 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.109502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.109602 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.109602 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.109769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.109941 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110210 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110297 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110476 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110567 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110654 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110839 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.110950 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.111038 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.111126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.111126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.111324 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.111474 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.111609 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.111708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.111802 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.111898 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.111986 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112163 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112256 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112349 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112445 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112539 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112632 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112720 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112720 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112874 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.112969 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.113062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.113148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.113239 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.113334 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.113440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.113535 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.113620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.113752 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.114427 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.114525 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.114622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.114710 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.114794 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.114887 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.114972 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.115073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.115174 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.115338 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.115490 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.115583 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.115669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.115753 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.115847 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.115935 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116019 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116128 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116216 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116315 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116409 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116504 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116590 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116854 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.116942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.117034 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.117128 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.117221 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.117314 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.117476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.117566 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.117650 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.117741 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.117827 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.117921 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118007 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118099 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118271 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118356 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118449 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118542 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118635 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118728 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.118907 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.119006 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.119094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.119186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.119295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.119446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.119537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.119633 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.119728 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.119815 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.119898 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120033 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120131 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120227 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120321 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120422 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120611 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120706 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120801 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120886 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.120971 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.121062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.121156 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.121305 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.121408 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.121408 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.121408 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.121408 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.121819 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.121925 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122014 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122099 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122099 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122099 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122610 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122695 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122695 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122859 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.122947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.123099 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.123184 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.123184 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.123184 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.123517 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.123608 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.123693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.123778 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.123870 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.123970 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124057 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124151 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124236 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124335 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124439 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124528 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124680 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.124936 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125023 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125108 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125191 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125276 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125466 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125554 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125628 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125712 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125887 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.125986 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126073 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126159 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126242 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126325 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126422 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126510 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126593 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126848 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.126944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127032 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127123 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127217 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127319 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127605 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127689 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127867 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.127963 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128049 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128135 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128302 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128394 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128489 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128663 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128754 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128841 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.128926 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129020 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129198 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129273 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129475 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129565 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129658 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.129921 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130116 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130465 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130560 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130653 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130746 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130839 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.130925 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.131010 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.131106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.131195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.131462 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.131574 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.131666 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.131742 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.131834 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.131928 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132282 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:38:06.132371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.132371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.133829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.134107 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.134284 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.134622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.134900 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.135221 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.135565 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.135882 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.136197 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.136516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.136885 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.137143 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.137454 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.137769 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.141060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.141060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.141060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.141060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.141060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.141060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.141798 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.141915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.142209 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.142550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.142876 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.143202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.144257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.144257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.144257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.144636 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.144752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.145119 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.145427 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.145734 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.146057 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.146369 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.147233 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.147233 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.147605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.148557 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.148986 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.149390 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.149767 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.150792 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.151084 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.151847 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.151847 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.152216 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.152657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.153015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.153361 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.153664 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.153976 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.154289 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.154605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.154920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.155234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.155593 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.155923 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.156231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.156537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.156844 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.157161 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.157465 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.157770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.158075 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.158379 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.158690 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.159003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.159330 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.159639 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.159952 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.160258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.161117 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.161448 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.161775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.162082 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.162396 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.162708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.163020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.163369 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.163686 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.164001 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.164349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.164663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.165226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.165539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.165860 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.166195 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.166540 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.166830 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.167136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.167469 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.167794 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.168108 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.168420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.168733 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.169042 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.169359 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.169669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.169978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.170349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.170595 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.170904 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.171238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.171577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.171887 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.172198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.172541 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.172863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.173180 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.173496 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.173811 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.174124 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.174432 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.174739 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.175047 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.175384 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.175715 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.176029 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.176886 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.177312 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.177628 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.177950 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.178273 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.178584 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.178922 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.179246 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.179584 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.179906 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.180220 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.180550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.180885 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.181213 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.181537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.181844 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.182148 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.182449 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.182758 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.183077 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.183405 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.183710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.184015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.184324 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.184627 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.184932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.185236 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.185538 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.185845 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.186158 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.186451 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.186752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.187054 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.187380 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.187685 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.187855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO dbcounter [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Registered counter for database nova_api May 27 09:38:06.187993 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.188299 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.188605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.188908 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.189212 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.189519 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.189845 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.190178 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.190492 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.190815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.191122 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.191520 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.191856 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.192179 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.192498 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.192816 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.193127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.193457 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.193768 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.194079 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.194390 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.194697 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.195005 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.195330 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.195660 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.195985 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.196289 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.196612 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.196929 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.197252 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.197569 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.197879 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.198208 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.198517 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.198825 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.199138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.199478 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.199790 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.200104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.200418 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.200744 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.201069 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.201375 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.201699 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.202023 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.202370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.202867 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.203063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.203368 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.203683 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.203998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.204303 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:38:06.204550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:38:06.207693 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_db.sqlalchemy.engines [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:38:06.215186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writer thread running {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:38:06.264225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO dbcounter [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Registered counter for database nova_api May 27 09:38:06.271438 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.context [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e023520c-85e2-4ea4-af21-7ff61f036f3f(cell1) {{(pid=129290) load_cells /opt/stack/nova/nova/context.py:464}} May 27 09:38:06.275538 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:06.277092 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:06.277895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:06.279894 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:06.282615 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO dbcounter [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Registered counter for database nova_cell0 May 27 09:38:06.283701 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_db.sqlalchemy.engines [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129291) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:38:06.286429 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO dbcounter [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Registered counter for database nova_cell1 May 27 09:38:06.291770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writer thread running {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:38:06.295515 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_db.sqlalchemy.engines [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:38:06.296667 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_db.sqlalchemy.engines [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:38:06.303833 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writer thread running {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:38:06.305083 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writer thread running {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:38:06.348865 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.context [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e023520c-85e2-4ea4-af21-7ff61f036f3f(cell1) {{(pid=129291) load_cells /opt/stack/nova/nova/context.py:464}} May 27 09:38:06.353265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:06.354846 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:06.355749 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:06.357719 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:06.359745 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO dbcounter [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Registered counter for database nova_cell0 May 27 09:38:06.363655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO dbcounter [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Registered counter for database nova_cell1 May 27 09:38:06.370774 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_db.sqlalchemy.engines [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129291) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:38:06.372994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_db.sqlalchemy.engines [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129291) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:38:06.377975 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writer thread running {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:38:06.380611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writer thread running {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:38:06.450067 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO dbcounter [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Registered counter for database nova_cell0 May 27 09:38:06.456706 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_db.sqlalchemy.engines [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:38:06.461531 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writer thread running {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:38:06.525134 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO dbcounter [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Registered counter for database nova_cell0 May 27 09:38:06.532007 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_db.sqlalchemy.engines [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129291) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:38:06.536894 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writer thread running {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:38:06.775012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: WARNING keystonemiddleware.auth_token [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:38:06.782281 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: WARNING keystonemiddleware.auth_token [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:38:06.866387 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: WARNING keystonemiddleware.auth_token [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:38:06.874026 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: WARNING keystonemiddleware.auth_token [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:38:07.152142 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: WARNING keystonemiddleware.auth_token [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:38:07.159240 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: WARNING keystonemiddleware.auth_token [None req-e5797f60-3d82-494c-bca0-c4334a01d208 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:38:07.164740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fdfe7e79c0 pid: 129290 (default app) May 27 09:38:07.213658 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: WARNING keystonemiddleware.auth_token [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:38:07.219730 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: WARNING keystonemiddleware.auth_token [None req-cbc98cbb-008b-48dd-b151-fbceb95bba3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:38:07.225287 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fdfe7e79c0 pid: 129291 (default app) May 27 09:38:46.473818 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:46.474882 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:46.480134 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:46.480890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:47.044734 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c3df1695-3b38-4045-b359-de6584bb40e3 tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] Action: 'create', calling method: .version_select at 0x7f188d9e5c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1538940913", "metadata": {"Type": "work"}}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:48.629473 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c3df1695-3b38-4045-b359-de6584bb40e3 tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.161384 May 27 09:38:48.638009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1155 bytes} [Fri May 27 09:38:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2171 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 09:38:48.645387 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:48.646242 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:48.648607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:48.649539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:48.869771 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-346ca5ee-7589-4467-b37c-6bd8937ae821 tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] Calling method '.version_select at 0x7f188d9b5790>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:49.399806 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-13c72282-6276-4285-bd3e-227f859da4a4 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Action: 'create', calling method: .version_select at 0x7f188d832af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2134084325"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:49.882234 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-13c72282-6276-4285-bd3e-227f859da4a4 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.941423 May 27 09:38:49.890042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 2/2] 10.222.0.41 () {60 vars in 1154 bytes} [Fri May 27 09:38:48 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 943 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 09:38:49.895326 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-aa09334c-7cd5-45f4-8867-1ac623e947e3 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d832d30>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:50.045629 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-aa09334c-7cd5-45f4-8867-1ac623e947e3 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54" status: 200 len: 345 microversion: 2.1 time: 0.154420 May 27 09:38:50.046492 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 3/3] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:38:49 2022] GET /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54 => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:38:50.234821 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-346ca5ee-7589-4467-b37c-6bd8937ae821 tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341" status: 200 len: 354 microversion: 2.1 time: 1.595060 May 27 09:38:50.235970 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 1/4] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:38:48 2022] GET /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341 => generated 354 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:38:50.249873 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-95d0d516-183c-47d6-b6df-c93a222dd4d1 tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] Calling method '.version_select at 0x7f188d8453a0>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:50.374868 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-95d0d516-183c-47d6-b6df-c93a222dd4d1 tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341" status: 200 len: 354 microversion: 2.1 time: 0.130045 May 27 09:38:50.375976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 4/5] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:38:50 2022] GET /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:50.402481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0a0966a1-5c16-4fe9-98b3-f32588e5b80a tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] Calling method '.version_select at 0x7f188d87db80>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:50.593481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0a0966a1-5c16-4fe9-98b3-f32588e5b80a tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341" status: 202 len: 0 microversion: 2.1 time: 0.204772 May 27 09:38:50.594053 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 2/6] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 09:38:50 2022] DELETE /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 09:38:50.602618 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f9db67c7-0150-420e-bba9-9059368e31ae tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] Calling method '.version_select at 0x7f188d845a60>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:50.671771 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f9db67c7-0150-420e-bba9-9059368e31ae tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341" status: 200 len: 353 microversion: 2.1 time: 0.073140 May 27 09:38:50.672533 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 5/7] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:38:50 2022] GET /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:51.059475 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e6bd7ef2-f4fe-465b-80ec-4b0999eff823 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d837280>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:51.363539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e6bd7ef2-f4fe-465b-80ec-4b0999eff823 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54" status: 200 len: 346 microversion: 2.1 time: 0.307955 May 27 09:38:51.364961 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 3/8] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:38:51 2022] GET /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54 => generated 346 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:51.377498 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-78b51247-bc26-4124-962b-33a96824a656 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Action: 'create', calling method: .version_select at 0x7f188d845d30>, body: {"snapshot": {"volume_id": "75189df8-a1e8-4e67-aa40-f89590c0fc54", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-740367754"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:51.787729 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2030751648", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "networks": [{"uuid": "a40ee27f-8386-4948-8fe3-6a3f0bfc0eb2"}]}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:51.936090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.network.neutron [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] validate_networks() for [('a40ee27f-8386-4948-8fe3-6a3f0bfc0eb2', None, None, None, None, None)] {{(pid=129291) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:38:51.957273 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-78b51247-bc26-4124-962b-33a96824a656 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.583483 May 27 09:38:51.958787 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 6/9] 10.222.0.41 () {60 vars in 1161 bytes} [Fri May 27 09:38:51 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:38:51.965235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a1e02c06-795c-4e7a-86c7-ad15bfb134dd tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] Calling method '.version_select at 0x7f188d845160>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:52.016613 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-a1e02c06-795c-4e7a-86c7-ad15bfb134dd tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] HTTP exception thrown: Volume 53af9190-2d6b-4651-8256-107be0548341 could not be found. May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a1e02c06-795c-4e7a-86c7-ad15bfb134dd tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] Request method failure captured: May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341 HTTP/1.1 May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJwmALHILafn2I9fxDgYjPmlZrUdov2kkKD3bg4zqyBvdnKvGUSzqMxYvS5_M6sEB5DfnjFYWdlt7G7bs3t8Kg_HYD5nzaAhj1x7vfPZRxMYVVgHq9oT-QiZFLBo783bDXcyspulsrej73wm_rRSKw6V0J2YZd3APmpHc_E432jcZqs May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 84ba4973a779495ab471f571b4fe1003 May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-VolumesGetTestJSON-1387787985 May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:38:52.022107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/84ba4973a779495ab471f571b4fe1003"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/84ba4973a779495ab471f571b4fe1003"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/84ba4973a779495ab471f571b4fe1003"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_84ba4973a779495ab471f571b4fe1003"}]}] May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-VolumesGetTestJSON-1387787985 May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 84ba4973a779495ab471f571b4fe1003 May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-VolumesGetTestJSON-1387787985 May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-VolumesGetTestJSON-1387787985-project May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 5e6748228e704e94a092ec7f6a50a21a May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-VolumesGetTestJSON-1387787985-project May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Volume 53af9190-2d6b-4651-8256-107be0548341 could not be found. May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '53af9190-2d6b-4651-8256-107be0548341'} May 27 09:38:52.023793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53af9190-2d6b-4651-8256-107be0548341 could not be found. (HTTP 404) (Request-ID: req-c6b7e85e-fd88-4788-b165-7ff02c1d2987) May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:38:52.024781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:38:52.026243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53af9190-2d6b-4651-8256-107be0548341 could not be found. May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 09:38:52.027596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53af9190-2d6b-4651-8256-107be0548341 could not be found. May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53af9190-2d6b-4651-8256-107be0548341 could not be found. May 27 09:38:52.028840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:38:52.030510 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a1e02c06-795c-4e7a-86c7-ad15bfb134dd tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] Returning 404 to user: Volume 53af9190-2d6b-4651-8256-107be0548341 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:38:52.033987 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a1e02c06-795c-4e7a-86c7-ad15bfb134dd tempest-VolumesGetTestJSON-1387787985 tempest-VolumesGetTestJSON-1387787985-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341" status: 404 len: 109 microversion: 2.1 time: 0.071051 May 27 09:38:52.036735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 7/10] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:38:51 2022] GET /compute/v2.1/os-volumes/53af9190-2d6b-4651-8256-107be0548341 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:38:52.043230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-87c7430a-4856-40c1-9791-bdd8c6f22d09 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d7ad430>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:52.092783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-87c7430a-4856-40c1-9791-bdd8c6f22d09 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 200 len: 286 microversion: 2.1 time: 0.054759 May 27 09:38:52.094001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 8/11] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:38:52 2022] GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:52.105418 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-75db765d-7bf2-409a-8223-29a724aa011a tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d7adaf0>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:52.186010 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-75db765d-7bf2-409a-8223-29a724aa011a tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.085150 May 27 09:38:52.186574 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 9/12] 10.222.0.41 () {58 vars in 1139 bytes} [Fri May 27 09:38:52 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:52.197746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-aeb6d006-3346-4aed-bde2-b8d0e398c15a tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d7ad8b0>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:52.255965 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-aeb6d006-3346-4aed-bde2-b8d0e398c15a tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 200 len: 286 microversion: 2.1 time: 0.061603 May 27 09:38:52.261170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 10/13] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:38:52 2022] GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:52.999966 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Flavor limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:38:53.000560 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Image limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:38:53.001185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Flavor pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:38:53.001677 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Image pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:38:53.002247 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:38:53.038237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:53.039889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:53.043570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:53.045476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:53.125477 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Getting quotas for project 7479df6fb46a412398b2e1749b0cbd96. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:38:53.143490 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Getting quotas for user f31b5e67d2ac4b80bf16a766a7f9f423 and project 7479df6fb46a412398b2e1749b0cbd96. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:38:53.197685 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Going to run 1 instances... {{(pid=129291) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:38:53.208478 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:38:53.268531 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e420704e-9d0d-4dfc-b058-be76314989eb tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d7ad280>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:53.468264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8b7b2f8d-58bb-44f9-8970-2c868c6f027e tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.942931 May 27 09:38:53.480775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 4/14] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:38:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:38:53.487014 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dbf12764-3f7f-4f43-86ba-3cd8640d52c1 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:53.492971 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dbf12764-3f7f-4f43-86ba-3cd8640d52c1 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:53.671999 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e420704e-9d0d-4dfc-b058-be76314989eb tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 200 len: 286 microversion: 2.1 time: 0.407557 May 27 09:38:53.672563 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 11/15] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:38:53 2022] GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 286 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:38:53.961165 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dbf12764-3f7f-4f43-86ba-3cd8640d52c1 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:54.021094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dbf12764-3f7f-4f43-86ba-3cd8640d52c1 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1215 microversion: 2.1 time: 0.538350 May 27 09:38:54.030258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 5/16] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:38:53 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1215 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:54.684465 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-47bebcc7-206d-4283-8e98-8bd53f428502 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d845a60>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:54.774700 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-47bebcc7-206d-4283-8e98-8bd53f428502 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 200 len: 286 microversion: 2.1 time: 0.094580 May 27 09:38:54.778745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 12/17] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:38:54 2022] GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:55.046227 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-26363fab-2a57-4aa0-9999-dbe139b1499c tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:55.046853 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-26363fab-2a57-4aa0-9999-dbe139b1499c tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:55.181204 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-26363fab-2a57-4aa0-9999-dbe139b1499c tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:55.189564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-26363fab-2a57-4aa0-9999-dbe139b1499c tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1215 microversion: 2.1 time: 0.146903 May 27 09:38:55.190346 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 6/18] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:38:55 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:55.788096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2cb8a786-fbd1-46ec-86e5-6a81e2f5f55d tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d84e1f0>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:55.827357 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2cb8a786-fbd1-46ec-86e5-6a81e2f5f55d tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 200 len: 286 microversion: 2.1 time: 0.044502 May 27 09:38:55.828134 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 13/19] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:38:55 2022] GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:56.210003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-62b37db2-6101-428a-a1f7-9fe297ff3e1b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:56.220698 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-62b37db2-6101-428a-a1f7-9fe297ff3e1b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:56.237676 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62b37db2-6101-428a-a1f7-9fe297ff3e1b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:56.238444 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62b37db2-6101-428a-a1f7-9fe297ff3e1b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:56.239775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62b37db2-6101-428a-a1f7-9fe297ff3e1b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:56.240509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62b37db2-6101-428a-a1f7-9fe297ff3e1b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:56.433885 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-62b37db2-6101-428a-a1f7-9fe297ff3e1b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:56.448487 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-62b37db2-6101-428a-a1f7-9fe297ff3e1b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1219 microversion: 2.1 time: 0.243066 May 27 09:38:56.451424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 7/20] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:38:56 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1219 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:56.851404 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-422d8b3d-3914-47f2-a39c-fbb901456e26 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d8d2550>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:56.922452 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-422d8b3d-3914-47f2-a39c-fbb901456e26 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 200 len: 286 microversion: 2.1 time: 0.085725 May 27 09:38:56.923027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 14/21] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:38:56 2022] GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:57.466979 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1ff7f70c-1b0a-45ee-8ba9-944d78c073be tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:57.468349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1ff7f70c-1b0a-45ee-8ba9-944d78c073be tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:57.475380 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1ff7f70c-1b0a-45ee-8ba9-944d78c073be tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:57.480016 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1ff7f70c-1b0a-45ee-8ba9-944d78c073be tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:57.481046 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1ff7f70c-1b0a-45ee-8ba9-944d78c073be tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:57.482258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1ff7f70c-1b0a-45ee-8ba9-944d78c073be tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:57.823018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1ff7f70c-1b0a-45ee-8ba9-944d78c073be tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:57.837235 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1ff7f70c-1b0a-45ee-8ba9-944d78c073be tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1219 microversion: 2.1 time: 0.374111 May 27 09:38:57.837821 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 8/22] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:38:57 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1219 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:57.934204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-77c5383e-6d6c-4e6c-83c1-384e8b37fd9f tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d7ade50>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:57.999488 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-77c5383e-6d6c-4e6c-83c1-384e8b37fd9f tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 200 len: 286 microversion: 2.1 time: 0.069148 May 27 09:38:58.000850 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 15/23] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:38:57 2022] GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:58.855859 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f865e8ea-7ca4-4cd7-a008-0830bf7a3879 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:58.857228 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f865e8ea-7ca4-4cd7-a008-0830bf7a3879 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:58.865841 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f865e8ea-7ca4-4cd7-a008-0830bf7a3879 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:58.866297 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f865e8ea-7ca4-4cd7-a008-0830bf7a3879 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:58.867086 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f865e8ea-7ca4-4cd7-a008-0830bf7a3879 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:58.867603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f865e8ea-7ca4-4cd7-a008-0830bf7a3879 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:58.970968 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f865e8ea-7ca4-4cd7-a008-0830bf7a3879 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:59.012055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-aa32e119-ca4f-4991-b552-cad778680df0 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d7ad670>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:59.014615 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f865e8ea-7ca4-4cd7-a008-0830bf7a3879 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1267 microversion: 2.1 time: 0.163096 May 27 09:38:59.016287 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 9/24] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:38:58 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:59.070994 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-aa32e119-ca4f-4991-b552-cad778680df0 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 200 len: 287 microversion: 2.1 time: 0.062457 May 27 09:38:59.076940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 16/25] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:38:59 2022] GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:38:59.082190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ab5cdbc8-8230-4e10-9526-74a7c92a927a tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188c634670>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:59.227785 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ab5cdbc8-8230-4e10-9526-74a7c92a927a tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 202 len: 0 microversion: 2.1 time: 0.149297 May 27 09:38:59.228459 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 10/26] 10.222.0.41 () {58 vars in 1253 bytes} [Fri May 27 09:38:59 2022] DELETE /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:38:59.236516 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-3c746db6-9cef-4016-afb7-efa49ca3d2e9 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d84e430>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:59.303363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3c746db6-9cef-4016-afb7-efa49ca3d2e9 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 200 len: 286 microversion: 2.1 time: 0.070188 May 27 09:38:59.303684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 17/27] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:38:59 2022] GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:00.036918 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c5af3014-c675-4850-8d89-7939837c18c6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:00.038224 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c5af3014-c675-4850-8d89-7939837c18c6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:00.073905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c5af3014-c675-4850-8d89-7939837c18c6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:00.074366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c5af3014-c675-4850-8d89-7939837c18c6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:00.075162 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c5af3014-c675-4850-8d89-7939837c18c6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:00.075631 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c5af3014-c675-4850-8d89-7939837c18c6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:00.282826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c5af3014-c675-4850-8d89-7939837c18c6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:00.294619 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c5af3014-c675-4850-8d89-7939837c18c6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1273 microversion: 2.1 time: 0.265425 May 27 09:39:00.306707 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 11/28] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:00 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:00.314446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-08300f9f-9049-46b6-8bb2-47dcd4ff4b93 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d7ad040>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:00.361717 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-08300f9f-9049-46b6-8bb2-47dcd4ff4b93 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] HTTP exception thrown: Snapshot c0b256fe-896e-47c7-9beb-f4a6fae86f6e could not be found. May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-08300f9f-9049-46b6-8bb2-47dcd4ff4b93 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Request method failure captured: May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e HTTP/1.1 May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJwo5gOBLzPac3VtUymYzcxKz51R0UbCJS7kuB3NVIhSiJvWNaS_V_9Txa88Kjbn-1DqDPu4_QN1D8epePIqDnZDYevIU_6txhAGEoFBhM4Dus3Nz-MUCfOtaOTxCRAzZXKH_oobaD4XD0OzFPBW7SMBNW4fZ7mpXJ1hWQJiEVZ98vA May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 28f5838929ea4e148c78de44e6f8333f May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:39:00.363927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_28f5838929ea4e148c78de44e6f8333f"}]}] May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 28f5838929ea4e148c78de44e6f8333f May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-VolumesSnapshotsTestJSON-1916689052-project May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 8e175ff5381a4e92a04d2b1bb5cdd5dc May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1916689052-project May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Snapshot c0b256fe-896e-47c7-9beb-f4a6fae86f6e could not be found. May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': 'c0b256fe-896e-47c7-9beb-f4a6fae86f6e'} May 27 09:39:00.365139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c0b256fe-896e-47c7-9beb-f4a6fae86f6e could not be found. (HTTP 404) (Request-ID: req-f09bf41a-6229-4ac8-8dd4-a0ff9091b58f) May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.365983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:39:00.367009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c0b256fe-896e-47c7-9beb-f4a6fae86f6e could not be found. May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 27 09:39:00.368085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c0b256fe-896e-47c7-9beb-f4a6fae86f6e could not be found. May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c0b256fe-896e-47c7-9beb-f4a6fae86f6e could not be found. May 27 09:39:00.370039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.371159 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-08300f9f-9049-46b6-8bb2-47dcd4ff4b93 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Returning 404 to user: Snapshot c0b256fe-896e-47c7-9beb-f4a6fae86f6e could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:39:00.371159 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-08300f9f-9049-46b6-8bb2-47dcd4ff4b93 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e" status: 404 len: 111 microversion: 2.1 time: 0.060436 May 27 09:39:00.371750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 18/29] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:39:00 2022] GET /compute/v2.1/os-snapshots/c0b256fe-896e-47c7-9beb-f4a6fae86f6e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:39:00.382136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-95245117-9df3-479f-baff-8f13d93f1087 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188c634940>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:00.578617 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-95245117-9df3-479f-baff-8f13d93f1087 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54" status: 202 len: 0 microversion: 2.1 time: 0.201069 May 27 09:39:00.579190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 12/30] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 09:39:00 2022] DELETE /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:39:00.591746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5b76f9d0-ec32-434a-9342-4e3e69345f17 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188e1c70d0>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:00.895461 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-5b76f9d0-ec32-434a-9342-4e3e69345f17 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] HTTP exception thrown: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5b76f9d0-ec32-434a-9342-4e3e69345f17 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Request method failure captured: May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54 HTTP/1.1 May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJwo5gOBLzPac3VtUymYzcxKz51R0UbCJS7kuB3NVIhSiJvWNaS_V_9Txa88Kjbn-1DqDPu4_QN1D8epePIqDnZDYevIU_6txhAGEoFBhM4Dus3Nz-MUCfOtaOTxCRAzZXKH_oobaD4XD0OzFPBW7SMBNW4fZ7mpXJ1hWQJiEVZ98vA May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 28f5838929ea4e148c78de44e6f8333f May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:39:00.898096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_28f5838929ea4e148c78de44e6f8333f"}]}] May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 28f5838929ea4e148c78de44e6f8333f May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-VolumesSnapshotsTestJSON-1916689052-project May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 8e175ff5381a4e92a04d2b1bb5cdd5dc May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1916689052-project May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '75189df8-a1e8-4e67-aa40-f89590c0fc54'} May 27 09:39:00.899419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. (HTTP 404) (Request-ID: req-db06bf7d-eb1c-49de-8718-2b7460a9677d) May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:00.900155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:39:00.901176 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 09:39:00.902880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:00.904220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:00.906857 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5b76f9d0-ec32-434a-9342-4e3e69345f17 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Returning 404 to user: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:39:00.907878 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5b76f9d0-ec32-434a-9342-4e3e69345f17 tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54" status: 404 len: 109 microversion: 2.1 time: 0.322301 May 27 09:39:00.918892 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 19/31] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:39:00 2022] GET /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54 => generated 109 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:39:00.922965 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e2d6f6d1-1764-4db3-bd7d-c1bd48f821ce tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188c695310>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:01.085875 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-e2d6f6d1-1764-4db3-bd7d-c1bd48f821ce tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] HTTP exception thrown: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e2d6f6d1-1764-4db3-bd7d-c1bd48f821ce tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Request method failure captured: May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54 HTTP/1.1 May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJwo5gOBLzPac3VtUymYzcxKz51R0UbCJS7kuB3NVIhSiJvWNaS_V_9Txa88Kjbn-1DqDPu4_QN1D8epePIqDnZDYevIU_6txhAGEoFBhM4Dus3Nz-MUCfOtaOTxCRAzZXKH_oobaD4XD0OzFPBW7SMBNW4fZ7mpXJ1hWQJiEVZ98vA May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 28f5838929ea4e148c78de44e6f8333f May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:39:01.090573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_28f5838929ea4e148c78de44e6f8333f"}]}] May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 28f5838929ea4e148c78de44e6f8333f May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-VolumesSnapshotsTestJSON-1916689052-project May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 8e175ff5381a4e92a04d2b1bb5cdd5dc May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1916689052-project May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '75189df8-a1e8-4e67-aa40-f89590c0fc54'} May 27 09:39:01.091652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. (HTTP 404) (Request-ID: req-e4f723a3-4ec6-4637-95c5-25a1127cf52f) May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:01.092264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:39:01.093259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 09:39:01.094139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e2d6f6d1-1764-4db3-bd7d-c1bd48f821ce tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Returning 404 to user: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e2d6f6d1-1764-4db3-bd7d-c1bd48f821ce tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54" status: 404 len: 109 microversion: 2.1 time: 0.173551 May 27 09:39:01.095090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 13/32] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 09:39:00 2022] DELETE /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54 => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:39:01.102281 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-23a10d81-ac6d-4f60-8043-b434a4b96e8c tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Calling method '.version_select at 0x7f188d7ad1f0>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:01.232146 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-23a10d81-ac6d-4f60-8043-b434a4b96e8c tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] HTTP exception thrown: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-23a10d81-ac6d-4f60-8043-b434a4b96e8c tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Request method failure captured: May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54 HTTP/1.1 May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJwo5gOBLzPac3VtUymYzcxKz51R0UbCJS7kuB3NVIhSiJvWNaS_V_9Txa88Kjbn-1DqDPu4_QN1D8epePIqDnZDYevIU_6txhAGEoFBhM4Dus3Nz-MUCfOtaOTxCRAzZXKH_oobaD4XD0OzFPBW7SMBNW4fZ7mpXJ1hWQJiEVZ98vA May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 28f5838929ea4e148c78de44e6f8333f May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:39:01.234774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/28f5838929ea4e148c78de44e6f8333f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_28f5838929ea4e148c78de44e6f8333f"}]}] May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 28f5838929ea4e148c78de44e6f8333f May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1916689052 May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-VolumesSnapshotsTestJSON-1916689052-project May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 8e175ff5381a4e92a04d2b1bb5cdd5dc May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1916689052-project May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '75189df8-a1e8-4e67-aa40-f89590c0fc54'} May 27 09:39:01.236055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. (HTTP 404) (Request-ID: req-507534f7-fdd5-4687-b515-0fadb8718ecf) May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:01.236788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:39:01.238264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 09:39:01.239216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-23a10d81-ac6d-4f60-8043-b434a4b96e8c tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] Returning 404 to user: Volume 75189df8-a1e8-4e67-aa40-f89590c0fc54 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:39:01.240212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-23a10d81-ac6d-4f60-8043-b434a4b96e8c tempest-VolumesSnapshotsTestJSON-1916689052 tempest-VolumesSnapshotsTestJSON-1916689052-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54" status: 404 len: 109 microversion: 2.1 time: 0.138745 May 27 09:39:01.243011 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 20/33] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:39:01 2022] GET /compute/v2.1/os-volumes/75189df8-a1e8-4e67-aa40-f89590c0fc54 => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:39:01.313900 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-199d6eae-15c4-4c79-b509-bc8f5d4e495b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:01.316624 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-199d6eae-15c4-4c79-b509-bc8f5d4e495b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:01.338218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-199d6eae-15c4-4c79-b509-bc8f5d4e495b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:01.338823 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-199d6eae-15c4-4c79-b509-bc8f5d4e495b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:01.339854 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-199d6eae-15c4-4c79-b509-bc8f5d4e495b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:01.340495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-199d6eae-15c4-4c79-b509-bc8f5d4e495b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:02.278098 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-199d6eae-15c4-4c79-b509-bc8f5d4e495b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:02.287190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-199d6eae-15c4-4c79-b509-bc8f5d4e495b tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.977004 May 27 09:39:02.295825 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 14/34] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:01 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:03.313946 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bcd3d1d4-e270-420e-8640-b07a725ff4d3 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:03.317224 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bcd3d1d4-e270-420e-8640-b07a725ff4d3 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:03.344632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bcd3d1d4-e270-420e-8640-b07a725ff4d3 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:03.346924 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bcd3d1d4-e270-420e-8640-b07a725ff4d3 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:03.351313 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bcd3d1d4-e270-420e-8640-b07a725ff4d3 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:03.351931 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bcd3d1d4-e270-420e-8640-b07a725ff4d3 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:03.959742 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bcd3d1d4-e270-420e-8640-b07a725ff4d3 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:04.015793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bcd3d1d4-e270-420e-8640-b07a725ff4d3 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.702275 May 27 09:39:04.016777 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 21/35] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:03 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:05.042627 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1f49ad2c-4fd0-4b43-ab08-5dd215fc3cc6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:05.045101 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1f49ad2c-4fd0-4b43-ab08-5dd215fc3cc6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:05.056787 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:05.058540 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1f49ad2c-4fd0-4b43-ab08-5dd215fc3cc6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:05.073454 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1f49ad2c-4fd0-4b43-ab08-5dd215fc3cc6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:05.074335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1f49ad2c-4fd0-4b43-ab08-5dd215fc3cc6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:05.074772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1f49ad2c-4fd0-4b43-ab08-5dd215fc3cc6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:05.195123 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=10 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:05.788337 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1f49ad2c-4fd0-4b43-ab08-5dd215fc3cc6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:05.804644 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1f49ad2c-4fd0-4b43-ab08-5dd215fc3cc6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.775225 May 27 09:39:05.815893 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 15/36] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:05 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:06.145701 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e8ef89a5-eaef-4037-9829-a6572c6c4d4a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'create', calling method: .version_select at 0x7f188d757f70>, body: {"keypair": {"name": "tempest-keypair-516210192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3z4Q6EaUpWH78f5hZCEhJBX9o58T/eFaILkuR+/yfkweUv8Vu/qygG4cBNbfFwJft18C9ZYkUYEDSu4vAp2m//7B+k8KRvw1ZSOTCfCocoipl3UA8Ba8XNPFyuD60DqQ=="}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:06.320170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-e8ef89a5-eaef-4037-9829-a6572c6c4d4a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Getting quotas for project fbb8746f17d6410f9c82d0fde348d1f9. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:39:06.342282 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-e8ef89a5-eaef-4037-9829-a6572c6c4d4a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Getting quotas for user 5b0d25ff6a664177b463b834124802d5 and project fbb8746f17d6410f9c82d0fde348d1f9. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:39:06.490938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e8ef89a5-eaef-4037-9829-a6572c6c4d4a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.677794 May 27 09:39:06.508793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 22/37] 10.222.0.41 () {62 vars in 1199 bytes} [Fri May 27 09:39:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 696 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 09:39:06.822147 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d94b07d6-9fe2-40ce-992f-b086ae961d45 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:06.823394 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d94b07d6-9fe2-40ce-992f-b086ae961d45 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:06.836299 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d94b07d6-9fe2-40ce-992f-b086ae961d45 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:06.844150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d94b07d6-9fe2-40ce-992f-b086ae961d45 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:06.847706 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d94b07d6-9fe2-40ce-992f-b086ae961d45 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:06.848193 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d94b07d6-9fe2-40ce-992f-b086ae961d45 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:07.414818 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d94b07d6-9fe2-40ce-992f-b086ae961d45 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:07.427996 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d94b07d6-9fe2-40ce-992f-b086ae961d45 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.608000 May 27 09:39:07.431006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 16/38] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:06 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:08.445323 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6e12cd95-493d-40df-a8b1-7b0fb7b9746d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:08.452704 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6e12cd95-493d-40df-a8b1-7b0fb7b9746d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:08.493604 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6e12cd95-493d-40df-a8b1-7b0fb7b9746d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:08.495685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6e12cd95-493d-40df-a8b1-7b0fb7b9746d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:08.503751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6e12cd95-493d-40df-a8b1-7b0fb7b9746d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:08.504491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6e12cd95-493d-40df-a8b1-7b0fb7b9746d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:09.176991 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6e12cd95-493d-40df-a8b1-7b0fb7b9746d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:09.195927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6e12cd95-493d-40df-a8b1-7b0fb7b9746d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.754294 May 27 09:39:09.200399 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 23/39] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:08 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:09.624899 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1013222055", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:09.796424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.network.neutron [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] validate_networks() for [('7b6e2b01-d1c7-4bef-b4c4-509cdfcf99eb', None, None, None, None, None)] {{(pid=129291) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:39:10.057944 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-13dfe56b-184d-4dc1-a579-a176837ecb62 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'create', calling method: .version_select at 0x7f188ce2ee50>, body: {"keypair": {"name": "tempest-keypair-324865065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgLdDGWddycT8bPgS/heQM3Hwsvx1Wi6bgyqpBDUoou0kFLYC+8zqDQZSsZc+PbENVpnjPQL57sFvyTSumoBR8ndSdmGwfxmqlHDeqNrWZTK7flMCkV05V6WKxZkQg4ig=="}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:10.147159 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-13dfe56b-184d-4dc1-a579-a176837ecb62 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Getting quotas for project 06332dc6f29b4d01b047104d93bbef0f. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:39:10.169195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-13dfe56b-184d-4dc1-a579-a176837ecb62 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Getting quotas for user 2463c2327e364ca996768e3eb6ef6316 and project 06332dc6f29b4d01b047104d93bbef0f. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:39:10.282250 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-13dfe56b-184d-4dc1-a579-a176837ecb62 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.440852 May 27 09:39:10.296319 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 24/40] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 09:39:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:10.322232 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bd9ecb7a-5a19-40b8-9748-d74d83833e4f tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:10.330760 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bd9ecb7a-5a19-40b8-9748-d74d83833e4f tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:10.380661 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd9ecb7a-5a19-40b8-9748-d74d83833e4f tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:10.410124 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd9ecb7a-5a19-40b8-9748-d74d83833e4f tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:10.412784 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd9ecb7a-5a19-40b8-9748-d74d83833e4f tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:10.423023 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd9ecb7a-5a19-40b8-9748-d74d83833e4f tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:11.485163 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bd9ecb7a-5a19-40b8-9748-d74d83833e4f tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:11.498873 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bd9ecb7a-5a19-40b8-9748-d74d83833e4f tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 1.198298 May 27 09:39:11.508032 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 25/41] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:10 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:12.525118 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b4f9327e-bb5a-48ff-a7a2-029b75975878 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:12.526004 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b4f9327e-bb5a-48ff-a7a2-029b75975878 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:12.538405 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b4f9327e-bb5a-48ff-a7a2-029b75975878 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:12.539031 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b4f9327e-bb5a-48ff-a7a2-029b75975878 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:12.540025 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b4f9327e-bb5a-48ff-a7a2-029b75975878 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:12.540612 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b4f9327e-bb5a-48ff-a7a2-029b75975878 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:14.029064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b4f9327e-bb5a-48ff-a7a2-029b75975878 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:14.046291 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b4f9327e-bb5a-48ff-a7a2-029b75975878 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 1.525149 May 27 09:39:14.049617 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 26/42] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:12 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:14.279765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Flavor limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:39:14.280261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Image limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:39:14.280698 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Flavor pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:39:14.281086 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Image pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:39:14.281507 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:39:14.296613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:14.301625 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:14.305366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:14.307772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:14.375799 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Getting quotas for project 0cad683f27d14cf5a90a19525a467a52. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:39:14.412481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Getting quotas for user 1331ba69eaec44dd9bd8f8db7d53ba5c and project 0cad683f27d14cf5a90a19525a467a52. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:39:14.472308 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Going to run 1 instances... {{(pid=129291) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:39:14.480885 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:39:14.683495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-958c5364-ef57-4432-97f0-08179fd168b8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.838940 May 27 09:39:14.684249 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 17/43] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:39:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 5842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:39:14.695138 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-008cc52f-efd8-40bf-a5fd-4e6c66336a52 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:14.696014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-008cc52f-efd8-40bf-a5fd-4e6c66336a52 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:15.070323 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5e274a21-2a50-4c87-9d15-54b2f4406cad tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:15.071231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5e274a21-2a50-4c87-9d15-54b2f4406cad tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:15.086739 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5e274a21-2a50-4c87-9d15-54b2f4406cad tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:15.088797 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5e274a21-2a50-4c87-9d15-54b2f4406cad tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:15.092149 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5e274a21-2a50-4c87-9d15-54b2f4406cad tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:15.101912 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5e274a21-2a50-4c87-9d15-54b2f4406cad tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:15.284951 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-008cc52f-efd8-40bf-a5fd-4e6c66336a52 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:15.318064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-008cc52f-efd8-40bf-a5fd-4e6c66336a52 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1222 microversion: 2.1 time: 0.626544 May 27 09:39:15.320305 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 27/44] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:14 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1222 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:15.704048 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-e3ed5f30-9bab-41db-9df5-324d36c5b566 req-2d5b46e8-b7ff-4a22-b920-9d227ffd31b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415b9b30-f34e-4800-a994-d0d7cb7344e5", "tag": "91c5ca83-bcb7-4dd6-8333-c29ae094c13b"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:15.756292 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e3ed5f30-9bab-41db-9df5-324d36c5b566 req-2d5b46e8-b7ff-4a22-b920-9d227ffd31b1 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:15.756740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e3ed5f30-9bab-41db-9df5-324d36c5b566 req-2d5b46e8-b7ff-4a22-b920-9d227ffd31b1 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:15.890052 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-e3ed5f30-9bab-41db-9df5-324d36c5b566 req-2d5b46e8-b7ff-4a22-b920-9d227ffd31b1 service nova] Creating event network-changed:91c5ca83-bcb7-4dd6-8333-c29ae094c13b for instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 on hv-cinder-79760 May 27 09:39:15.890644 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e3ed5f30-9bab-41db-9df5-324d36c5b566 req-2d5b46e8-b7ff-4a22-b920-9d227ffd31b1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129290) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 09:39:15.891865 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3b84b6ce-66fe-4aa8-bd08-77a50ec59a55 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:15.892318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3b84b6ce-66fe-4aa8-bd08-77a50ec59a55 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:15.893702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3b84b6ce-66fe-4aa8-bd08-77a50ec59a55 None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:15.894139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3b84b6ce-66fe-4aa8-bd08-77a50ec59a55 None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:15.915125 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.compute.rpcapi [None req-3b84b6ce-66fe-4aa8-bd08-77a50ec59a55 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 09:39:15.935000 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3b84b6ce-66fe-4aa8-bd08-77a50ec59a55 None None] Releasing lock "compute-rpcapi-router" {{(pid=129290) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 09:39:15.976936 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3b84b6ce-66fe-4aa8-bd08-77a50ec59a55 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.652217 May 27 09:39:15.977668 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 28/45] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:16.003155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-553347309", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:16.310530 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] validate_networks() for [('7b6e2b01-d1c7-4bef-b4c4-509cdfcf99eb', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:39:17.826522 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5e274a21-2a50-4c87-9d15-54b2f4406cad tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:17.842352 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5e274a21-2a50-4c87-9d15-54b2f4406cad tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 2.776644 May 27 09:39:17.872692 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 18/46] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:15 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 2795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:17.872692 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2120469626", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90d3a2be-1adb-43f3-aa78-1e534bd2671b"}], "security_groups": [{"name": "tempest-securitygroup--772095189"}], "key_name": "tempest-keypair-516210192", "user_data": "}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:18.351539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.network.neutron [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] validate_networks() for [('90d3a2be-1adb-43f3-aa78-1e534bd2671b', None, None, None, None, None)] {{(pid=129291) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:39:19.182202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:19.858897 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Flavor limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:39:19.859351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Image limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:39:19.860306 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Flavor pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:39:19.860488 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Image pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:39:19.861079 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:39:19.875726 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:19.876533 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:19.878110 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:19.878783 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:19.897924 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=53 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:19.926250 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Getting quotas for project fbb8746f17d6410f9c82d0fde348d1f9. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:39:19.935581 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Getting quotas for user 5b0d25ff6a664177b463b834124802d5 and project fbb8746f17d6410f9c82d0fde348d1f9. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:39:19.966423 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Going to run 1 instances... {{(pid=129291) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:39:19.968007 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:39:19.968740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:39:19.969514 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:39:19.969938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:39:19.970588 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:39:19.970946 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:39:20.001520 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:20.019452 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:20.021271 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:20.023301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:20.103832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-927f4205-ebcf-4dc3-aab7-cd7092f002ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.243284 May 27 09:39:20.104728 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 19/47] 10.222.0.41 () {62 vars in 1187 bytes} [Fri May 27 09:39:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 09:39:20.112866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c6d53a09-7bd4-45bf-a6f3-078173d0dac6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:20.114338 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c6d53a09-7bd4-45bf-a6f3-078173d0dac6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:20.120839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c6d53a09-7bd4-45bf-a6f3-078173d0dac6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:20.121526 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c6d53a09-7bd4-45bf-a6f3-078173d0dac6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:20.122484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c6d53a09-7bd4-45bf-a6f3-078173d0dac6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:20.123093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c6d53a09-7bd4-45bf-a6f3-078173d0dac6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:20.149370 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Getting quotas for project 0cad683f27d14cf5a90a19525a467a52. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:39:20.167708 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Getting quotas for user 1331ba69eaec44dd9bd8f8db7d53ba5c and project 0cad683f27d14cf5a90a19525a467a52. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:39:20.217420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:39:20.220245 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:39:20.332982 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c6d53a09-7bd4-45bf-a6f3-078173d0dac6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:20.352478 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c6d53a09-7bd4-45bf-a6f3-078173d0dac6 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.245160 May 27 09:39:20.355063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 20/48] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:20 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:20.366601 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-558ead30-4dfb-45b3-9887-9fa097f39549 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:20.374300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-558ead30-4dfb-45b3-9887-9fa097f39549 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:20.450613 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-be1851dc-9712-47fc-955a-e27aa62d5a70 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.471404 May 27 09:39:20.451340 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 29/49] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:39:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 4473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:39:20.461818 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-142817985", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7de8cf2a-342a-4bc6-91a1-b3ed2cf7f88d"}], "security_groups": [{"name": "tempest-securitygroup--1651473618"}], "key_name": "tempest-keypair-324865065", "user_data": "}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:21.098362 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-558ead30-4dfb-45b3-9887-9fa097f39549 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:21.107130 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-558ead30-4dfb-45b3-9887-9fa097f39549 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:21.118370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-558ead30-4dfb-45b3-9887-9fa097f39549 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:21.119516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-558ead30-4dfb-45b3-9887-9fa097f39549 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1281 microversion: 2.20 time: 0.761983 May 27 09:39:21.120101 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 21/50] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:20 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1281 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:21.143497 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-122c4393-d6b3-4b1c-bcec-f005089ab471 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:21.144215 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-122c4393-d6b3-4b1c-bcec-f005089ab471 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:21.225138 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] validate_networks() for [('7de8cf2a-342a-4bc6-91a1-b3ed2cf7f88d', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:39:21.226992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-122c4393-d6b3-4b1c-bcec-f005089ab471 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:21.239916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-122c4393-d6b3-4b1c-bcec-f005089ab471 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1221 microversion: 2.1 time: 0.108515 May 27 09:39:21.241665 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 22/51] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:21 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:21.372025 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0f40b2c3-ab58-4979-8b27-76a64648b301 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:21.373300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0f40b2c3-ab58-4979-8b27-76a64648b301 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:21.380667 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f40b2c3-ab58-4979-8b27-76a64648b301 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:21.381640 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f40b2c3-ab58-4979-8b27-76a64648b301 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:21.382661 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f40b2c3-ab58-4979-8b27-76a64648b301 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:21.383445 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f40b2c3-ab58-4979-8b27-76a64648b301 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:21.636791 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0f40b2c3-ab58-4979-8b27-76a64648b301 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:21.661665 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0f40b2c3-ab58-4979-8b27-76a64648b301 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.293316 May 27 09:39:21.679505 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 23/52] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:21 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:21.795507 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:39:21.796012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:39:21.796496 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:39:21.797321 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:39:21.797744 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:39:21.809714 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:21.810485 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:21.811572 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:21.812775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:21.841371 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Getting quotas for project 06332dc6f29b4d01b047104d93bbef0f. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:39:21.847054 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Getting quotas for user 2463c2327e364ca996768e3eb6ef6316 and project 06332dc6f29b4d01b047104d93bbef0f. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:39:21.860879 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:39:21.864420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:39:21.935947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c3169433-22bb-4263-a37b-3eb26dea8a38 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.482275 May 27 09:39:21.936652 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 30/53] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:39:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:39:21.950964 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8909b96d-ecc7-42be-ae38-8db8127aa2ed tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:21.951966 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8909b96d-ecc7-42be-ae38-8db8127aa2ed tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:22.052015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8909b96d-ecc7-42be-ae38-8db8127aa2ed tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:22.065761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8909b96d-ecc7-42be-ae38-8db8127aa2ed tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1236 microversion: 2.1 time: 0.122218 May 27 09:39:22.066590 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 24/54] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:21 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1236 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:22.137977 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1df81948-58ba-4c7c-bfce-fff0cbe32bdb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:22.138605 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1df81948-58ba-4c7c-bfce-fff0cbe32bdb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:22.146679 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1df81948-58ba-4c7c-bfce-fff0cbe32bdb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:22.147133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1df81948-58ba-4c7c-bfce-fff0cbe32bdb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:22.150948 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1df81948-58ba-4c7c-bfce-fff0cbe32bdb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:22.151818 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1df81948-58ba-4c7c-bfce-fff0cbe32bdb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:22.260963 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7f421efb-1de1-4021-b494-5acd332b72f0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:22.261909 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7f421efb-1de1-4021-b494-5acd332b72f0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:22.273923 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7f421efb-1de1-4021-b494-5acd332b72f0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:22.274664 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7f421efb-1de1-4021-b494-5acd332b72f0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:22.278466 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7f421efb-1de1-4021-b494-5acd332b72f0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:22.279237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7f421efb-1de1-4021-b494-5acd332b72f0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:22.287307 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1df81948-58ba-4c7c-bfce-fff0cbe32bdb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:22.299817 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1df81948-58ba-4c7c-bfce-fff0cbe32bdb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:22.301331 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1df81948-58ba-4c7c-bfce-fff0cbe32bdb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:22.302849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1df81948-58ba-4c7c-bfce-fff0cbe32bdb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1285 microversion: 2.20 time: 0.168901 May 27 09:39:22.307474 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 31/55] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:22 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:22.374862 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7f421efb-1de1-4021-b494-5acd332b72f0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:22.385569 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7f421efb-1de1-4021-b494-5acd332b72f0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1225 microversion: 2.1 time: 0.128119 May 27 09:39:22.396198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 25/56] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:22 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1225 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:22.680081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-573c7412-0a33-4370-b17e-7ba3011a2a4d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:22.680639 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-573c7412-0a33-4370-b17e-7ba3011a2a4d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:22.690683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-573c7412-0a33-4370-b17e-7ba3011a2a4d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:22.691740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-573c7412-0a33-4370-b17e-7ba3011a2a4d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:22.693323 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-573c7412-0a33-4370-b17e-7ba3011a2a4d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:22.693869 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-573c7412-0a33-4370-b17e-7ba3011a2a4d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:22.877733 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-573c7412-0a33-4370-b17e-7ba3011a2a4d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:22.888583 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-573c7412-0a33-4370-b17e-7ba3011a2a4d tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.211227 May 27 09:39:22.895573 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 32/57] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:22 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:23.083080 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4f801d4d-8158-43b2-abb2-0a863808d35d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:23.083724 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4f801d4d-8158-43b2-abb2-0a863808d35d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:23.089724 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f801d4d-8158-43b2-abb2-0a863808d35d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.090163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f801d4d-8158-43b2-abb2-0a863808d35d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.090928 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f801d4d-8158-43b2-abb2-0a863808d35d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.091388 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f801d4d-8158-43b2-abb2-0a863808d35d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.156686 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4f801d4d-8158-43b2-abb2-0a863808d35d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:23.167385 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4f801d4d-8158-43b2-abb2-0a863808d35d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1240 microversion: 2.1 time: 0.088075 May 27 09:39:23.167961 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 26/58] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:23 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:23.325783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8675afbd-9cb9-4f50-8684-1ed0d8d710b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:23.326397 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8675afbd-9cb9-4f50-8684-1ed0d8d710b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:23.333375 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8675afbd-9cb9-4f50-8684-1ed0d8d710b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.333905 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8675afbd-9cb9-4f50-8684-1ed0d8d710b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.334674 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8675afbd-9cb9-4f50-8684-1ed0d8d710b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.335102 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8675afbd-9cb9-4f50-8684-1ed0d8d710b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.404222 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-afbc19d9-907f-4576-b43f-58c487d757c9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:23.404815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-afbc19d9-907f-4576-b43f-58c487d757c9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:23.413411 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-afbc19d9-907f-4576-b43f-58c487d757c9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.422376 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-afbc19d9-907f-4576-b43f-58c487d757c9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.423414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-afbc19d9-907f-4576-b43f-58c487d757c9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.424493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-afbc19d9-907f-4576-b43f-58c487d757c9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.435522 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8675afbd-9cb9-4f50-8684-1ed0d8d710b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:23.443669 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8675afbd-9cb9-4f50-8684-1ed0d8d710b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:23.445195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8675afbd-9cb9-4f50-8684-1ed0d8d710b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:23.448820 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8675afbd-9cb9-4f50-8684-1ed0d8d710b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1285 microversion: 2.20 time: 0.127309 May 27 09:39:23.449385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 33/59] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:23 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:23.515392 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-afbc19d9-907f-4576-b43f-58c487d757c9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:23.525666 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-afbc19d9-907f-4576-b43f-58c487d757c9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1225 microversion: 2.1 time: 0.125206 May 27 09:39:23.526461 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 27/60] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:23 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:23.902685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-82cd2f76-0f8f-4f5e-9147-727150b60c24 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:23.903614 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-82cd2f76-0f8f-4f5e-9147-727150b60c24 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:23.910685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-82cd2f76-0f8f-4f5e-9147-727150b60c24 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.911232 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-82cd2f76-0f8f-4f5e-9147-727150b60c24 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.912385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-82cd2f76-0f8f-4f5e-9147-727150b60c24 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.913628 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-82cd2f76-0f8f-4f5e-9147-727150b60c24 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:24.188235 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b2ca1dba-8c63-4f5d-9ac1-73ae70ee519c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:24.188921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b2ca1dba-8c63-4f5d-9ac1-73ae70ee519c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:24.217795 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-82cd2f76-0f8f-4f5e-9147-727150b60c24 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:24.231370 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-82cd2f76-0f8f-4f5e-9147-727150b60c24 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.332534 May 27 09:39:24.237129 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b2ca1dba-8c63-4f5d-9ac1-73ae70ee519c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.237757 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b2ca1dba-8c63-4f5d-9ac1-73ae70ee519c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:24.238578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b2ca1dba-8c63-4f5d-9ac1-73ae70ee519c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.239018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b2ca1dba-8c63-4f5d-9ac1-73ae70ee519c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:24.240954 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 34/61] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:23 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:24.469403 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4e15370f-f0a1-4054-b597-164449a76dd7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:24.470191 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4e15370f-f0a1-4054-b597-164449a76dd7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:24.480423 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e15370f-f0a1-4054-b597-164449a76dd7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.487014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e15370f-f0a1-4054-b597-164449a76dd7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:24.488387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e15370f-f0a1-4054-b597-164449a76dd7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.489170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e15370f-f0a1-4054-b597-164449a76dd7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:24.764098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4e15370f-f0a1-4054-b597-164449a76dd7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:24.780683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4e15370f-f0a1-4054-b597-164449a76dd7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:24.785492 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4e15370f-f0a1-4054-b597-164449a76dd7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:24.793119 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4e15370f-f0a1-4054-b597-164449a76dd7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1285 microversion: 2.20 time: 0.325546 May 27 09:39:24.793805 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 35/62] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:24 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1285 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:24.809045 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b2ca1dba-8c63-4f5d-9ac1-73ae70ee519c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:24.817103 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7679abd6-9567-4281-91df-92479fa84b02 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:24.818465 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7679abd6-9567-4281-91df-92479fa84b02 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:24.819887 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b2ca1dba-8c63-4f5d-9ac1-73ae70ee519c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1240 microversion: 2.1 time: 0.639428 May 27 09:39:24.820891 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 28/63] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:24 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1240 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:24.853890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7679abd6-9567-4281-91df-92479fa84b02 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.855208 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7679abd6-9567-4281-91df-92479fa84b02 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:24.857123 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7679abd6-9567-4281-91df-92479fa84b02 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.857787 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7679abd6-9567-4281-91df-92479fa84b02 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:25.041415 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7679abd6-9567-4281-91df-92479fa84b02 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:25.055159 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7679abd6-9567-4281-91df-92479fa84b02 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1273 microversion: 2.1 time: 0.245489 May 27 09:39:25.056349 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 36/64] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:24 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:25.249043 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c1fc0c0c-4ccb-43bd-9091-2169a1d0f6bb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:25.249726 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c1fc0c0c-4ccb-43bd-9091-2169a1d0f6bb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:25.267953 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1fc0c0c-4ccb-43bd-9091-2169a1d0f6bb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:25.277125 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1fc0c0c-4ccb-43bd-9091-2169a1d0f6bb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:25.282830 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1fc0c0c-4ccb-43bd-9091-2169a1d0f6bb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:25.287262 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1fc0c0c-4ccb-43bd-9091-2169a1d0f6bb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:25.812916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-73a1e50c-0636-48fa-a5af-4cd2502fca41 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:25.815116 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-73a1e50c-0636-48fa-a5af-4cd2502fca41 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:25.826395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73a1e50c-0636-48fa-a5af-4cd2502fca41 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:25.827046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73a1e50c-0636-48fa-a5af-4cd2502fca41 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:25.828045 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73a1e50c-0636-48fa-a5af-4cd2502fca41 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:25.828681 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73a1e50c-0636-48fa-a5af-4cd2502fca41 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:26.042456 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c1fc0c0c-4ccb-43bd-9091-2169a1d0f6bb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:26.050007 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c1fc0c0c-4ccb-43bd-9091-2169a1d0f6bb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.805059 May 27 09:39:26.051424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 29/65] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:25 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:26.068440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-42eddbfb-cb70-4a87-97ad-bd3a5277ca17 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:26.070019 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-42eddbfb-cb70-4a87-97ad-bd3a5277ca17 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:26.083211 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-42eddbfb-cb70-4a87-97ad-bd3a5277ca17 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:26.083973 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-42eddbfb-cb70-4a87-97ad-bd3a5277ca17 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:26.084998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-42eddbfb-cb70-4a87-97ad-bd3a5277ca17 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:26.086264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-42eddbfb-cb70-4a87-97ad-bd3a5277ca17 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:26.120018 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-73a1e50c-0636-48fa-a5af-4cd2502fca41 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:26.128874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-73a1e50c-0636-48fa-a5af-4cd2502fca41 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:26.130388 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-73a1e50c-0636-48fa-a5af-4cd2502fca41 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:26.131538 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-73a1e50c-0636-48fa-a5af-4cd2502fca41 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1341 microversion: 2.20 time: 0.323535 May 27 09:39:26.154751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 37/66] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:25 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1341 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:26.160679 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4b07a5db-fe8c-4e88-acf2-178b1501d7a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:26.161529 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4b07a5db-fe8c-4e88-acf2-178b1501d7a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:26.173738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4b07a5db-fe8c-4e88-acf2-178b1501d7a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:26.184058 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4b07a5db-fe8c-4e88-acf2-178b1501d7a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:26.184903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4b07a5db-fe8c-4e88-acf2-178b1501d7a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:26.185350 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4b07a5db-fe8c-4e88-acf2-178b1501d7a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:26.517287 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-42eddbfb-cb70-4a87-97ad-bd3a5277ca17 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:26.525570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-42eddbfb-cb70-4a87-97ad-bd3a5277ca17 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1306 microversion: 2.1 time: 0.472828 May 27 09:39:26.527803 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 30/67] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:26 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1306 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:26.536846 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4b07a5db-fe8c-4e88-acf2-178b1501d7a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:26.539877 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4b07a5db-fe8c-4e88-acf2-178b1501d7a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1279 microversion: 2.1 time: 0.383027 May 27 09:39:26.542237 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 38/68] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:26 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1279 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:27.073338 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-557c0a16-8652-4821-8439-d74bf058a087 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:27.074760 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-557c0a16-8652-4821-8439-d74bf058a087 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:27.092730 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-557c0a16-8652-4821-8439-d74bf058a087 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.095663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-557c0a16-8652-4821-8439-d74bf058a087 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.101847 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-557c0a16-8652-4821-8439-d74bf058a087 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.102637 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-557c0a16-8652-4821-8439-d74bf058a087 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.157339 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0ea7c0af-3b2d-422c-81eb-e3385f4432f2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:27.159887 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0ea7c0af-3b2d-422c-81eb-e3385f4432f2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:27.164101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:27.180523 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ea7c0af-3b2d-422c-81eb-e3385f4432f2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.186634 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ea7c0af-3b2d-422c-81eb-e3385f4432f2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.188255 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ea7c0af-3b2d-422c-81eb-e3385f4432f2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.189829 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ea7c0af-3b2d-422c-81eb-e3385f4432f2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.247157 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=81 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:27.399698 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0ea7c0af-3b2d-422c-81eb-e3385f4432f2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:27.417627 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0ea7c0af-3b2d-422c-81eb-e3385f4432f2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:27.423814 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0ea7c0af-3b2d-422c-81eb-e3385f4432f2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:27.429562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0ea7c0af-3b2d-422c-81eb-e3385f4432f2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1339 microversion: 2.20 time: 0.276233 May 27 09:39:27.433424 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 39/69] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:27 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1339 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:27.547770 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-266ad9e6-562e-41c1-b37d-39bea570dec2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:27.548546 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-266ad9e6-562e-41c1-b37d-39bea570dec2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:27.558044 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-266ad9e6-562e-41c1-b37d-39bea570dec2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.559086 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-266ad9e6-562e-41c1-b37d-39bea570dec2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.560291 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-266ad9e6-562e-41c1-b37d-39bea570dec2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.562661 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-266ad9e6-562e-41c1-b37d-39bea570dec2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.823487 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-266ad9e6-562e-41c1-b37d-39bea570dec2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:27.837370 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-266ad9e6-562e-41c1-b37d-39bea570dec2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1294 microversion: 2.1 time: 0.296455 May 27 09:39:27.842397 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 40/70] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:27 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1294 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:27.856052 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-cb89aa3a-bfa6-49f3-9b3b-c5c21f4ae0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:27.860031 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-cb89aa3a-bfa6-49f3-9b3b-c5c21f4ae0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:27.883619 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb89aa3a-bfa6-49f3-9b3b-c5c21f4ae0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.884087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb89aa3a-bfa6-49f3-9b3b-c5c21f4ae0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.889136 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb89aa3a-bfa6-49f3-9b3b-c5c21f4ae0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.889593 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb89aa3a-bfa6-49f3-9b3b-c5c21f4ae0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.161857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-557c0a16-8652-4821-8439-d74bf058a087 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:28.171863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-557c0a16-8652-4821-8439-d74bf058a087 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 1.107958 May 27 09:39:28.193278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 31/71] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:27 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:28.260833 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-496ecf7b-d7d2-447b-ad48-ee36060b70d5 req-b393f32e-7a37-4c52-a69b-7eb3e3c770a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415b9b30-f34e-4800-a994-d0d7cb7344e5", "name": "network-vif-plugged", "status": "completed", "tag": "91c5ca83-bcb7-4dd6-8333-c29ae094c13b"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:28.276747 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-496ecf7b-d7d2-447b-ad48-ee36060b70d5 req-b393f32e-7a37-4c52-a69b-7eb3e3c770a2 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.277441 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-496ecf7b-d7d2-447b-ad48-ee36060b70d5 req-b393f32e-7a37-4c52-a69b-7eb3e3c770a2 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.304595 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-496ecf7b-d7d2-447b-ad48-ee36060b70d5 req-b393f32e-7a37-4c52-a69b-7eb3e3c770a2 service nova] Creating event network-vif-plugged:91c5ca83-bcb7-4dd6-8333-c29ae094c13b for instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 on hv-cinder-79760 May 27 09:39:28.305197 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-496ecf7b-d7d2-447b-ad48-ee36060b70d5 req-b393f32e-7a37-4c52-a69b-7eb3e3c770a2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129291) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 09:39:28.306366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d22699b-4a3f-4af5-949f-d50920ddf0e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.306859 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d22699b-4a3f-4af5-949f-d50920ddf0e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.307800 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d22699b-4a3f-4af5-949f-d50920ddf0e1 None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.308238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d22699b-4a3f-4af5-949f-d50920ddf0e1 None None] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.319923 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.compute.rpcapi [None req-1d22699b-4a3f-4af5-949f-d50920ddf0e1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 09:39:28.321063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d22699b-4a3f-4af5-949f-d50920ddf0e1 None None] Releasing lock "compute-rpcapi-router" {{(pid=129291) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 09:39:28.338539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1d22699b-4a3f-4af5-949f-d50920ddf0e1 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143283 May 27 09:39:28.339892 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 32/72] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:28.429456 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-10842327-89b7-463e-877b-4ccbefc6618c req-614ab822-50bc-4754-a5cb-cbfd85b75832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf3a64e-1d00-4751-816f-74abd2af6e39", "tag": "adc5b363-c80d-48e0-98dd-a4279791062f"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:28.438493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-10842327-89b7-463e-877b-4ccbefc6618c req-614ab822-50bc-4754-a5cb-cbfd85b75832 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.439770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-10842327-89b7-463e-877b-4ccbefc6618c req-614ab822-50bc-4754-a5cb-cbfd85b75832 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.453618 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-10842327-89b7-463e-877b-4ccbefc6618c req-614ab822-50bc-4754-a5cb-cbfd85b75832 service nova] Creating event network-changed:adc5b363-c80d-48e0-98dd-a4279791062f for instance abf3a64e-1d00-4751-816f-74abd2af6e39 on hv-cinder-79760 May 27 09:39:28.460078 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-10842327-89b7-463e-877b-4ccbefc6618c req-614ab822-50bc-4754-a5cb-cbfd85b75832 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118641 May 27 09:39:28.461163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 33/73] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:28.466706 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-412b7cb8-6c02-4b63-b95b-e7c6847802d8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:28.468036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-412b7cb8-6c02-4b63-b95b-e7c6847802d8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:28.475468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-412b7cb8-6c02-4b63-b95b-e7c6847802d8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.475996 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-412b7cb8-6c02-4b63-b95b-e7c6847802d8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.476917 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-412b7cb8-6c02-4b63-b95b-e7c6847802d8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.477427 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-412b7cb8-6c02-4b63-b95b-e7c6847802d8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.540985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cb89aa3a-bfa6-49f3-9b3b-c5c21f4ae0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:28.553034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-cb89aa3a-bfa6-49f3-9b3b-c5c21f4ae0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.708807 May 27 09:39:28.563567 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 41/74] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:27 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:28.590831 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-412b7cb8-6c02-4b63-b95b-e7c6847802d8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:28.602572 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-412b7cb8-6c02-4b63-b95b-e7c6847802d8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:28.606440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-412b7cb8-6c02-4b63-b95b-e7c6847802d8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:28.608032 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-412b7cb8-6c02-4b63-b95b-e7c6847802d8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1339 microversion: 2.20 time: 0.145686 May 27 09:39:28.612104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 34/75] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:28 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1339 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:28.858337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ec3b1518-7c78-40cb-9593-7a7c88d5b23a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:28.859670 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ec3b1518-7c78-40cb-9593-7a7c88d5b23a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:28.872110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ec3b1518-7c78-40cb-9593-7a7c88d5b23a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.872624 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ec3b1518-7c78-40cb-9593-7a7c88d5b23a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.876263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ec3b1518-7c78-40cb-9593-7a7c88d5b23a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.877656 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ec3b1518-7c78-40cb-9593-7a7c88d5b23a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:29.190495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2106ed95-d9b3-4c39-a75a-c1b6695627af tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:29.191859 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2106ed95-d9b3-4c39-a75a-c1b6695627af tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:29.198212 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2106ed95-d9b3-4c39-a75a-c1b6695627af tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:29.198866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2106ed95-d9b3-4c39-a75a-c1b6695627af tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:29.199837 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2106ed95-d9b3-4c39-a75a-c1b6695627af tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:29.200273 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2106ed95-d9b3-4c39-a75a-c1b6695627af tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:29.515481 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ec3b1518-7c78-40cb-9593-7a7c88d5b23a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:29.523682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ec3b1518-7c78-40cb-9593-7a7c88d5b23a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1294 microversion: 2.1 time: 0.669173 May 27 09:39:29.524271 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 42/76] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:28 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1294 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:29.573643 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-804fb2c2-5309-42f0-beae-2aeabc333b10 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:29.574285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-804fb2c2-5309-42f0-beae-2aeabc333b10 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:29.599647 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-804fb2c2-5309-42f0-beae-2aeabc333b10 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:29.600489 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-804fb2c2-5309-42f0-beae-2aeabc333b10 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:29.601485 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-804fb2c2-5309-42f0-beae-2aeabc333b10 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:29.602079 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-804fb2c2-5309-42f0-beae-2aeabc333b10 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:30.168080 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2106ed95-d9b3-4c39-a75a-c1b6695627af tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:30.183934 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2106ed95-d9b3-4c39-a75a-c1b6695627af tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.995324 May 27 09:39:30.184923 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 35/77] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:29 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:30.197849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1f715a13-53b5-420f-b217-1c8ecab08cf5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:30.199404 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1f715a13-53b5-420f-b217-1c8ecab08cf5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:30.215342 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1f715a13-53b5-420f-b217-1c8ecab08cf5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:30.217186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1f715a13-53b5-420f-b217-1c8ecab08cf5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:30.218331 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1f715a13-53b5-420f-b217-1c8ecab08cf5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:30.220968 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1f715a13-53b5-420f-b217-1c8ecab08cf5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:30.299587 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-804fb2c2-5309-42f0-beae-2aeabc333b10 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:30.310313 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-804fb2c2-5309-42f0-beae-2aeabc333b10 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.741874 May 27 09:39:30.311073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 43/78] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:29 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:30.541128 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-63d8a539-38fc-4bfe-aba7-5c62058f0553 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:30.541713 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-63d8a539-38fc-4bfe-aba7-5c62058f0553 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:30.555436 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-63d8a539-38fc-4bfe-aba7-5c62058f0553 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:30.559140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-63d8a539-38fc-4bfe-aba7-5c62058f0553 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:30.560892 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-63d8a539-38fc-4bfe-aba7-5c62058f0553 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:30.567236 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-63d8a539-38fc-4bfe-aba7-5c62058f0553 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.090466 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1f715a13-53b5-420f-b217-1c8ecab08cf5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:31.109223 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1f715a13-53b5-420f-b217-1c8ecab08cf5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:31.111810 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1f715a13-53b5-420f-b217-1c8ecab08cf5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:31.113433 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1f715a13-53b5-420f-b217-1c8ecab08cf5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.925507 May 27 09:39:31.114638 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 36/79] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:30 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:31.119914 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-3fbab87f-f580-4d06-b4d8-be0861fef423 req-0563f16f-0c1f-419d-87a1-1b0dfb5ce174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2cecc3-140a-45b6-8b02-86784963dcf8", "tag": "d50b1a7c-b3da-4b5c-bca2-2cc99a43949e"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:31.128780 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-3fbab87f-f580-4d06-b4d8-be0861fef423 req-0563f16f-0c1f-419d-87a1-1b0dfb5ce174 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:31.129658 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-3fbab87f-f580-4d06-b4d8-be0861fef423 req-0563f16f-0c1f-419d-87a1-1b0dfb5ce174 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.141661 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-3fbab87f-f580-4d06-b4d8-be0861fef423 req-0563f16f-0c1f-419d-87a1-1b0dfb5ce174 service nova] Creating event network-changed:d50b1a7c-b3da-4b5c-bca2-2cc99a43949e for instance 7b2cecc3-140a-45b6-8b02-86784963dcf8 on hv-cinder-79760 May 27 09:39:31.150082 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-3fbab87f-f580-4d06-b4d8-be0861fef423 req-0563f16f-0c1f-419d-87a1-1b0dfb5ce174 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033932 May 27 09:39:31.151008 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 37/80] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:31.203890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b6d4cfaa-8c93-4ef0-903c-fed21d851512 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:31.205314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b6d4cfaa-8c93-4ef0-903c-fed21d851512 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:31.215327 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b6d4cfaa-8c93-4ef0-903c-fed21d851512 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:31.217523 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b6d4cfaa-8c93-4ef0-903c-fed21d851512 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.218553 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b6d4cfaa-8c93-4ef0-903c-fed21d851512 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:31.219774 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b6d4cfaa-8c93-4ef0-903c-fed21d851512 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.269981 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-63d8a539-38fc-4bfe-aba7-5c62058f0553 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:31.281659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-63d8a539-38fc-4bfe-aba7-5c62058f0553 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.744270 May 27 09:39:31.283681 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 44/81] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:30 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:31.328115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-836b92aa-744c-4550-b754-02eeeba749be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:31.329218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-836b92aa-744c-4550-b754-02eeeba749be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:31.338032 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-836b92aa-744c-4550-b754-02eeeba749be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:31.338485 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-836b92aa-744c-4550-b754-02eeeba749be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.339300 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-836b92aa-744c-4550-b754-02eeeba749be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:31.339774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-836b92aa-744c-4550-b754-02eeeba749be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.501880 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b6d4cfaa-8c93-4ef0-903c-fed21d851512 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:31.514664 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b6d4cfaa-8c93-4ef0-903c-fed21d851512 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.316419 May 27 09:39:31.526602 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 38/82] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:31 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:31.568143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-836b92aa-744c-4550-b754-02eeeba749be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:31.577827 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-836b92aa-744c-4550-b754-02eeeba749be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.253936 May 27 09:39:31.589600 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 45/83] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:31 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:32.132669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5ccc39bd-779d-4852-ba08-2d456aa43252 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:32.133345 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5ccc39bd-779d-4852-ba08-2d456aa43252 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:32.140635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=18 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:32.143503 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5ccc39bd-779d-4852-ba08-2d456aa43252 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.144567 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5ccc39bd-779d-4852-ba08-2d456aa43252 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.146297 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5ccc39bd-779d-4852-ba08-2d456aa43252 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.147424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5ccc39bd-779d-4852-ba08-2d456aa43252 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.302056 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5e5c7ea8-4f68-4451-b3da-ac5cf59d49ab tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:32.303359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5e5c7ea8-4f68-4451-b3da-ac5cf59d49ab tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:32.306353 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=6 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:32.307980 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=22 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:32.327705 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e5c7ea8-4f68-4451-b3da-ac5cf59d49ab tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.327977 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5ccc39bd-779d-4852-ba08-2d456aa43252 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:32.328399 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e5c7ea8-4f68-4451-b3da-ac5cf59d49ab tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.328988 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e5c7ea8-4f68-4451-b3da-ac5cf59d49ab tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.329421 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e5c7ea8-4f68-4451-b3da-ac5cf59d49ab tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.342398 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5ccc39bd-779d-4852-ba08-2d456aa43252 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:32.346113 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5ccc39bd-779d-4852-ba08-2d456aa43252 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:32.350578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5ccc39bd-779d-4852-ba08-2d456aa43252 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.220227 May 27 09:39:32.363320 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 39/84] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:32 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:32.535862 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-742052a1-c7a7-4c1f-8f23-f35a33e699c8 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:32.536709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-742052a1-c7a7-4c1f-8f23-f35a33e699c8 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:32.546570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-742052a1-c7a7-4c1f-8f23-f35a33e699c8 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.547450 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-742052a1-c7a7-4c1f-8f23-f35a33e699c8 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.548461 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-742052a1-c7a7-4c1f-8f23-f35a33e699c8 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.549373 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-742052a1-c7a7-4c1f-8f23-f35a33e699c8 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.935392 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5e5c7ea8-4f68-4451-b3da-ac5cf59d49ab tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:32.948580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5e5c7ea8-4f68-4451-b3da-ac5cf59d49ab tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.650321 May 27 09:39:32.949848 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 46/85] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:32 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:32.954599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fc1838c0-ac82-4391-b4f0-15f4e558e836 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:32.961915 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fc1838c0-ac82-4391-b4f0-15f4e558e836 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:32.977603 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc1838c0-ac82-4391-b4f0-15f4e558e836 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.978062 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc1838c0-ac82-4391-b4f0-15f4e558e836 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.981260 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc1838c0-ac82-4391-b4f0-15f4e558e836 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.981713 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc1838c0-ac82-4391-b4f0-15f4e558e836 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:33.116381 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-742052a1-c7a7-4c1f-8f23-f35a33e699c8 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:33.128646 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-742052a1-c7a7-4c1f-8f23-f35a33e699c8 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1315 microversion: 2.1 time: 0.597780 May 27 09:39:33.129876 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 40/86] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:32 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:33.370626 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e747f853-3861-436d-a94b-e5a73c61c721 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:33.371359 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e747f853-3861-436d-a94b-e5a73c61c721 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:33.388381 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e747f853-3861-436d-a94b-e5a73c61c721 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:33.393414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e747f853-3861-436d-a94b-e5a73c61c721 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:33.394501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e747f853-3861-436d-a94b-e5a73c61c721 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:33.394951 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e747f853-3861-436d-a94b-e5a73c61c721 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:33.408157 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=100 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:33.598733 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fc1838c0-ac82-4391-b4f0-15f4e558e836 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:33.609031 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fc1838c0-ac82-4391-b4f0-15f4e558e836 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.657944 May 27 09:39:33.610391 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 47/87] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:32 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:33.967333 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e57150f2-8de9-4c65-a3b2-d8a390baee2d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:33.968178 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e57150f2-8de9-4c65-a3b2-d8a390baee2d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:33.982342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e57150f2-8de9-4c65-a3b2-d8a390baee2d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:33.982804 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e57150f2-8de9-4c65-a3b2-d8a390baee2d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:33.986768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e57150f2-8de9-4c65-a3b2-d8a390baee2d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:33.987762 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e57150f2-8de9-4c65-a3b2-d8a390baee2d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:34.515623 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e57150f2-8de9-4c65-a3b2-d8a390baee2d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:34.521001 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e747f853-3861-436d-a94b-e5a73c61c721 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:34.534895 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e747f853-3861-436d-a94b-e5a73c61c721 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:34.540598 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e747f853-3861-436d-a94b-e5a73c61c721 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:34.543328 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e57150f2-8de9-4c65-a3b2-d8a390baee2d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.577592 May 27 09:39:34.544127 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 48/88] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:33 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:34.546503 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e747f853-3861-436d-a94b-e5a73c61c721 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 1.180349 May 27 09:39:34.547937 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 41/89] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:33 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:34.567866 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-aa11bc00-53fc-4689-9b5f-919c9d2c6fa2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:34.570930 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-aa11bc00-53fc-4689-9b5f-919c9d2c6fa2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:34.604787 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa11bc00-53fc-4689-9b5f-919c9d2c6fa2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:34.611979 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa11bc00-53fc-4689-9b5f-919c9d2c6fa2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:34.614442 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa11bc00-53fc-4689-9b5f-919c9d2c6fa2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:34.616266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa11bc00-53fc-4689-9b5f-919c9d2c6fa2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:34.626551 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-15aea0e7-f72f-41d1-bb4c-6f9d2ada9d6f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:34.627941 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-15aea0e7-f72f-41d1-bb4c-6f9d2ada9d6f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:34.637322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-15aea0e7-f72f-41d1-bb4c-6f9d2ada9d6f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:34.657272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-15aea0e7-f72f-41d1-bb4c-6f9d2ada9d6f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:34.662006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-15aea0e7-f72f-41d1-bb4c-6f9d2ada9d6f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:34.662682 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-15aea0e7-f72f-41d1-bb4c-6f9d2ada9d6f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.346815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-15aea0e7-f72f-41d1-bb4c-6f9d2ada9d6f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:35.357792 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-aa11bc00-53fc-4689-9b5f-919c9d2c6fa2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:35.369645 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-aa11bc00-53fc-4689-9b5f-919c9d2c6fa2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1501 microversion: 2.1 time: 0.820168 May 27 09:39:35.370754 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-15aea0e7-f72f-41d1-bb4c-6f9d2ada9d6f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.748541 May 27 09:39:35.372520 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 49/90] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:34 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1501 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:35.386263 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 42/91] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:34 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:35.484797 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-c6ea4e68-54c2-4a2c-aa2b-24689ab23385 req-b43b6583-46c7-4be5-a2bb-d4d074b8d941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c817de-8115-43f6-9a05-6366318ea29f", "tag": "170fc0f5-d663-45e7-aca9-b414a735e887"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:35.506996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-c6ea4e68-54c2-4a2c-aa2b-24689ab23385 req-b43b6583-46c7-4be5-a2bb-d4d074b8d941 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.507803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-c6ea4e68-54c2-4a2c-aa2b-24689ab23385 req-b43b6583-46c7-4be5-a2bb-d4d074b8d941 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.531592 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-c6ea4e68-54c2-4a2c-aa2b-24689ab23385 req-b43b6583-46c7-4be5-a2bb-d4d074b8d941 service nova] Creating event network-changed:170fc0f5-d663-45e7-aca9-b414a735e887 for instance d5c817de-8115-43f6-9a05-6366318ea29f on hv-cinder-79760 May 27 09:39:35.540660 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-c6ea4e68-54c2-4a2c-aa2b-24689ab23385 req-b43b6583-46c7-4be5-a2bb-d4d074b8d941 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059616 May 27 09:39:35.541468 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 50/92] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:35.562038 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ae9c5abc-9570-489a-9758-9435b6ad3193 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:35.562589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ae9c5abc-9570-489a-9758-9435b6ad3193 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:35.568859 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-66cf6887-f7ff-4608-8cee-7415194d3bef tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:35.569819 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-66cf6887-f7ff-4608-8cee-7415194d3bef tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:35.572834 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ae9c5abc-9570-489a-9758-9435b6ad3193 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.577604 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ae9c5abc-9570-489a-9758-9435b6ad3193 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.582530 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ae9c5abc-9570-489a-9758-9435b6ad3193 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.582694 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ae9c5abc-9570-489a-9758-9435b6ad3193 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.584995 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-66cf6887-f7ff-4608-8cee-7415194d3bef tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.586835 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-66cf6887-f7ff-4608-8cee-7415194d3bef tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.588055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-66cf6887-f7ff-4608-8cee-7415194d3bef tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.590148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-66cf6887-f7ff-4608-8cee-7415194d3bef tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.986592 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ae9c5abc-9570-489a-9758-9435b6ad3193 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:35.994285 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ae9c5abc-9570-489a-9758-9435b6ad3193 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.436876 May 27 09:39:35.994864 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 43/93] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:35 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:36.001866 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-66cf6887-f7ff-4608-8cee-7415194d3bef tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:36.010298 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-66cf6887-f7ff-4608-8cee-7415194d3bef tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:36.011828 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-66cf6887-f7ff-4608-8cee-7415194d3bef tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:36.018599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-66cf6887-f7ff-4608-8cee-7415194d3bef tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.456182 May 27 09:39:36.029747 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 51/94] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:35 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:36.254475 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-b2d27210-c756-4505-bf6e-41c3b68a5ca6 req-cab221cb-f4b7-4a08-8a7e-96563fba7fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf3a64e-1d00-4751-816f-74abd2af6e39", "name": "network-vif-plugged", "status": "completed", "tag": "adc5b363-c80d-48e0-98dd-a4279791062f"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:36.277469 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-b2d27210-c756-4505-bf6e-41c3b68a5ca6 req-cab221cb-f4b7-4a08-8a7e-96563fba7fe4 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.277900 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-b2d27210-c756-4505-bf6e-41c3b68a5ca6 req-cab221cb-f4b7-4a08-8a7e-96563fba7fe4 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:36.312916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-b2d27210-c756-4505-bf6e-41c3b68a5ca6 req-cab221cb-f4b7-4a08-8a7e-96563fba7fe4 service nova] Creating event network-vif-plugged:adc5b363-c80d-48e0-98dd-a4279791062f for instance abf3a64e-1d00-4751-816f-74abd2af6e39 on hv-cinder-79760 May 27 09:39:36.324938 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-b2d27210-c756-4505-bf6e-41c3b68a5ca6 req-cab221cb-f4b7-4a08-8a7e-96563fba7fe4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074767 May 27 09:39:36.328866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 44/95] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:36.402616 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bb2bdbce-2da2-4726-8268-27d8ac8f4191 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:36.404026 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bb2bdbce-2da2-4726-8268-27d8ac8f4191 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:36.411697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bb2bdbce-2da2-4726-8268-27d8ac8f4191 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.412568 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bb2bdbce-2da2-4726-8268-27d8ac8f4191 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:36.413480 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bb2bdbce-2da2-4726-8268-27d8ac8f4191 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.414822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bb2bdbce-2da2-4726-8268-27d8ac8f4191 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:36.590622 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bb2bdbce-2da2-4726-8268-27d8ac8f4191 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:36.599888 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bb2bdbce-2da2-4726-8268-27d8ac8f4191 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.201556 May 27 09:39:36.600457 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 52/96] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:36 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:36.905861 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-79aaa44d-15d3-4bc9-bcf1-fa907c178e47 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41440f90-bd76-4bc4-ba75-a3059aad2d84"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:36.907170 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-79aaa44d-15d3-4bc9-bcf1-fa907c178e47 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:36.914218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-79aaa44d-15d3-4bc9-bcf1-fa907c178e47 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.914831 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-79aaa44d-15d3-4bc9-bcf1-fa907c178e47 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:36.915744 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-79aaa44d-15d3-4bc9-bcf1-fa907c178e47 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.916263 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-79aaa44d-15d3-4bc9-bcf1-fa907c178e47 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.012916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-96e1df5d-2234-4cc2-b8d1-6f36edcb79a9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:37.014900 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-96e1df5d-2234-4cc2-b8d1-6f36edcb79a9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:37.022702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-96e1df5d-2234-4cc2-b8d1-6f36edcb79a9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.023314 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-96e1df5d-2234-4cc2-b8d1-6f36edcb79a9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.024243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-96e1df5d-2234-4cc2-b8d1-6f36edcb79a9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.024794 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-96e1df5d-2234-4cc2-b8d1-6f36edcb79a9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.218463 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-96e1df5d-2234-4cc2-b8d1-6f36edcb79a9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:37.229388 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-96e1df5d-2234-4cc2-b8d1-6f36edcb79a9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.220610 May 27 09:39:37.240934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 53/97] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:37 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:37.258849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5e83f771-5213-4166-8f8c-8320a7ff7986 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:37.259644 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5e83f771-5213-4166-8f8c-8320a7ff7986 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:37.266157 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e83f771-5213-4166-8f8c-8320a7ff7986 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.266717 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e83f771-5213-4166-8f8c-8320a7ff7986 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.267633 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e83f771-5213-4166-8f8c-8320a7ff7986 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.268072 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e83f771-5213-4166-8f8c-8320a7ff7986 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.463262 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5e83f771-5213-4166-8f8c-8320a7ff7986 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:37.492130 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5e83f771-5213-4166-8f8c-8320a7ff7986 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:37.498313 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5e83f771-5213-4166-8f8c-8320a7ff7986 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:37.499681 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5e83f771-5213-4166-8f8c-8320a7ff7986 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.257235 May 27 09:39:37.500365 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 54/98] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:37 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:37.574028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-9b828687-7abc-4147-b12f-fea0fd1fe02f req-ba482ff7-93ee-423a-970e-3d447e6763f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7937af8-bbeb-4a70-bd98-1062cbe0d4c7", "tag": "6328b701-4055-487d-8cef-ec0bdfa4ceda"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:37.590871 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-9b828687-7abc-4147-b12f-fea0fd1fe02f req-ba482ff7-93ee-423a-970e-3d447e6763f4 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.592084 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-9b828687-7abc-4147-b12f-fea0fd1fe02f req-ba482ff7-93ee-423a-970e-3d447e6763f4 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.610247 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-9b828687-7abc-4147-b12f-fea0fd1fe02f req-ba482ff7-93ee-423a-970e-3d447e6763f4 service nova] Creating event network-changed:6328b701-4055-487d-8cef-ec0bdfa4ceda for instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 on hv-cinder-79760 May 27 09:39:37.620446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-9b828687-7abc-4147-b12f-fea0fd1fe02f req-ba482ff7-93ee-423a-970e-3d447e6763f4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050501 May 27 09:39:37.628212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 55/99] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:39:37.635440 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5db9d4d9-a620-42a8-a4fd-4ff97974dff6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:37.636977 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5db9d4d9-a620-42a8-a4fd-4ff97974dff6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:37.646675 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5db9d4d9-a620-42a8-a4fd-4ff97974dff6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.647440 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5db9d4d9-a620-42a8-a4fd-4ff97974dff6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.648674 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5db9d4d9-a620-42a8-a4fd-4ff97974dff6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.649681 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5db9d4d9-a620-42a8-a4fd-4ff97974dff6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.917609 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5db9d4d9-a620-42a8-a4fd-4ff97974dff6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:37.928688 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5db9d4d9-a620-42a8-a4fd-4ff97974dff6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.297309 May 27 09:39:37.932725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 56/100] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:37 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:38.249497 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d7fa11c5-5dd4-4695-b876-d421dc0519c9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:38.250146 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d7fa11c5-5dd4-4695-b876-d421dc0519c9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:38.258768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d7fa11c5-5dd4-4695-b876-d421dc0519c9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.259220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d7fa11c5-5dd4-4695-b876-d421dc0519c9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:38.260027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d7fa11c5-5dd4-4695-b876-d421dc0519c9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.260463 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d7fa11c5-5dd4-4695-b876-d421dc0519c9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:38.267191 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=100 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:38.318681 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=6 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:38.406527 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d7fa11c5-5dd4-4695-b876-d421dc0519c9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:38.414037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d7fa11c5-5dd4-4695-b876-d421dc0519c9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.169825 May 27 09:39:38.414696 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 57/101] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:38 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:38.517894 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-07263bbd-5f4c-4118-acf6-d25bc6a34917 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:38.518507 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-07263bbd-5f4c-4118-acf6-d25bc6a34917 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:38.525532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07263bbd-5f4c-4118-acf6-d25bc6a34917 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.525981 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07263bbd-5f4c-4118-acf6-d25bc6a34917 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:38.526750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07263bbd-5f4c-4118-acf6-d25bc6a34917 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.527183 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07263bbd-5f4c-4118-acf6-d25bc6a34917 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:38.691179 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-07263bbd-5f4c-4118-acf6-d25bc6a34917 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:38.701165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-07263bbd-5f4c-4118-acf6-d25bc6a34917 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:38.703092 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-07263bbd-5f4c-4118-acf6-d25bc6a34917 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:38.704228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-07263bbd-5f4c-4118-acf6-d25bc6a34917 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.190250 May 27 09:39:38.704821 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 58/102] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:38 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:38.950849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f2a7a55f-f8df-40ea-a7de-7f7246b584ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:38.951499 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f2a7a55f-f8df-40ea-a7de-7f7246b584ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:38.957562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2a7a55f-f8df-40ea-a7de-7f7246b584ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.958056 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2a7a55f-f8df-40ea-a7de-7f7246b584ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:38.958766 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2a7a55f-f8df-40ea-a7de-7f7246b584ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.959197 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2a7a55f-f8df-40ea-a7de-7f7246b584ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.115845 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f2a7a55f-f8df-40ea-a7de-7f7246b584ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.123386 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f2a7a55f-f8df-40ea-a7de-7f7246b584ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.177447 May 27 09:39:39.133171 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 59/103] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:38 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:39.431191 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-11d87b2a-e948-4b67-93ca-b0c2f9f1175a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:39.431856 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-11d87b2a-e948-4b67-93ca-b0c2f9f1175a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:39.438194 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11d87b2a-e948-4b67-93ca-b0c2f9f1175a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:39.439390 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11d87b2a-e948-4b67-93ca-b0c2f9f1175a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.440286 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11d87b2a-e948-4b67-93ca-b0c2f9f1175a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:39.440955 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11d87b2a-e948-4b67-93ca-b0c2f9f1175a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.594050 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-11d87b2a-e948-4b67-93ca-b0c2f9f1175a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.602089 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-11d87b2a-e948-4b67-93ca-b0c2f9f1175a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.174615 May 27 09:39:39.602858 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 60/104] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:39 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:39.724433 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-14c2afb6-5b61-4ac7-9878-37711047a9bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:39.725467 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-14c2afb6-5b61-4ac7-9878-37711047a9bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:39.734997 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-14c2afb6-5b61-4ac7-9878-37711047a9bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:39.735491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-14c2afb6-5b61-4ac7-9878-37711047a9bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.736812 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-14c2afb6-5b61-4ac7-9878-37711047a9bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:39.737254 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-14c2afb6-5b61-4ac7-9878-37711047a9bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.887437 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-14c2afb6-5b61-4ac7-9878-37711047a9bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.898407 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-14c2afb6-5b61-4ac7-9878-37711047a9bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.900131 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-14c2afb6-5b61-4ac7-9878-37711047a9bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.901395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-14c2afb6-5b61-4ac7-9878-37711047a9bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.182049 May 27 09:39:39.902028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 61/105] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:39 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:40.139950 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-62baa1c2-1bd4-4212-ba73-f46c4fb24f5a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:40.140575 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-62baa1c2-1bd4-4212-ba73-f46c4fb24f5a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:40.146668 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-62baa1c2-1bd4-4212-ba73-f46c4fb24f5a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.147345 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-62baa1c2-1bd4-4212-ba73-f46c4fb24f5a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.148101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-62baa1c2-1bd4-4212-ba73-f46c4fb24f5a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.148687 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-62baa1c2-1bd4-4212-ba73-f46c4fb24f5a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.291158 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-62baa1c2-1bd4-4212-ba73-f46c4fb24f5a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:40.301027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-62baa1c2-1bd4-4212-ba73-f46c4fb24f5a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.164764 May 27 09:39:40.301696 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 62/106] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:40 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:40.621796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8a368f32-3a36-40fa-ab19-e5eb91f9274a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:40.622503 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8a368f32-3a36-40fa-ab19-e5eb91f9274a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:40.634900 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8a368f32-3a36-40fa-ab19-e5eb91f9274a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.635081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8a368f32-3a36-40fa-ab19-e5eb91f9274a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.636209 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8a368f32-3a36-40fa-ab19-e5eb91f9274a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.636903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8a368f32-3a36-40fa-ab19-e5eb91f9274a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.809945 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8a368f32-3a36-40fa-ab19-e5eb91f9274a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:40.818354 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8a368f32-3a36-40fa-ab19-e5eb91f9274a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.200290 May 27 09:39:40.818937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 63/107] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:40 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:40.928699 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-da4e4270-01cf-429f-87f1-114d298ba1f9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:40.929316 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-da4e4270-01cf-429f-87f1-114d298ba1f9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:40.935309 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da4e4270-01cf-429f-87f1-114d298ba1f9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.935770 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da4e4270-01cf-429f-87f1-114d298ba1f9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.936542 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da4e4270-01cf-429f-87f1-114d298ba1f9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.937059 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da4e4270-01cf-429f-87f1-114d298ba1f9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.072001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-da4e4270-01cf-429f-87f1-114d298ba1f9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:41.082274 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-da4e4270-01cf-429f-87f1-114d298ba1f9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:41.083787 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-da4e4270-01cf-429f-87f1-114d298ba1f9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:41.084892 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-da4e4270-01cf-429f-87f1-114d298ba1f9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.160565 May 27 09:39:41.085599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 64/108] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:40 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:41.317332 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-78d41e5a-7ad1-4cf1-b819-7df3234df455 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:41.317944 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-78d41e5a-7ad1-4cf1-b819-7df3234df455 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:41.323925 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-78d41e5a-7ad1-4cf1-b819-7df3234df455 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:41.324365 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-78d41e5a-7ad1-4cf1-b819-7df3234df455 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.325121 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-78d41e5a-7ad1-4cf1-b819-7df3234df455 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:41.325551 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-78d41e5a-7ad1-4cf1-b819-7df3234df455 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.472405 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-78d41e5a-7ad1-4cf1-b819-7df3234df455 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:41.480164 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-78d41e5a-7ad1-4cf1-b819-7df3234df455 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.166826 May 27 09:39:41.480730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 65/109] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:41 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:41.838108 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a3bd2633-2485-498b-a4b0-a67bdcb7088f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:41.839040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a3bd2633-2485-498b-a4b0-a67bdcb7088f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:41.851437 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a3bd2633-2485-498b-a4b0-a67bdcb7088f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:41.852235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a3bd2633-2485-498b-a4b0-a67bdcb7088f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.859549 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a3bd2633-2485-498b-a4b0-a67bdcb7088f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:41.861750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a3bd2633-2485-498b-a4b0-a67bdcb7088f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.068585 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-79aaa44d-15d3-4bc9-bcf1-fa907c178e47 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "POST /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.158824 May 27 09:39:42.076182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 45/110] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:39:36 2022] POST /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5/os-volume_attachments => generated 194 bytes in 5176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:42.107932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6d29ec2c-5992-48b0-8388-7e25fe8e17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:42.113922 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6d29ec2c-5992-48b0-8388-7e25fe8e17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:42.123973 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6d29ec2c-5992-48b0-8388-7e25fe8e17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.124548 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6d29ec2c-5992-48b0-8388-7e25fe8e17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.125412 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6d29ec2c-5992-48b0-8388-7e25fe8e17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.126052 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6d29ec2c-5992-48b0-8388-7e25fe8e17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.359739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a3bd2633-2485-498b-a4b0-a67bdcb7088f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.370844 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a3bd2633-2485-498b-a4b0-a67bdcb7088f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.537632 May 27 09:39:42.371668 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 66/111] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:41 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:42.376932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6d29ec2c-5992-48b0-8388-7e25fe8e17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.387162 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6d29ec2c-5992-48b0-8388-7e25fe8e17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.388720 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6d29ec2c-5992-48b0-8388-7e25fe8e17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.389849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6d29ec2c-5992-48b0-8388-7e25fe8e17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.289205 May 27 09:39:42.390504 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 46/112] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:42 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:42.499016 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4f46ee5d-3a84-4136-88a0-5bbd3862f6e7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:42.499758 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4f46ee5d-3a84-4136-88a0-5bbd3862f6e7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:42.505695 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4f46ee5d-3a84-4136-88a0-5bbd3862f6e7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.506140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4f46ee5d-3a84-4136-88a0-5bbd3862f6e7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.506938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4f46ee5d-3a84-4136-88a0-5bbd3862f6e7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.507414 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4f46ee5d-3a84-4136-88a0-5bbd3862f6e7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.644606 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4f46ee5d-3a84-4136-88a0-5bbd3862f6e7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.652644 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4f46ee5d-3a84-4136-88a0-5bbd3862f6e7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.158445 May 27 09:39:42.653530 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 67/113] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:42 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:43.398371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f5599330-c9a4-4939-8e28-a3273a85c865 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:43.399889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f5599330-c9a4-4939-8e28-a3273a85c865 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:43.406621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f5599330-c9a4-4939-8e28-a3273a85c865 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.407193 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f5599330-c9a4-4939-8e28-a3273a85c865 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.408512 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f5599330-c9a4-4939-8e28-a3273a85c865 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.408951 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f5599330-c9a4-4939-8e28-a3273a85c865 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.412519 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5acc4312-6e86-4eac-8725-58ca0b501d19 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:43.416454 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5acc4312-6e86-4eac-8725-58ca0b501d19 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:43.429236 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5acc4312-6e86-4eac-8725-58ca0b501d19 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.429682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5acc4312-6e86-4eac-8725-58ca0b501d19 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.430500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5acc4312-6e86-4eac-8725-58ca0b501d19 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.431347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5acc4312-6e86-4eac-8725-58ca0b501d19 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.804663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f5599330-c9a4-4939-8e28-a3273a85c865 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:43.813892 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f5599330-c9a4-4939-8e28-a3273a85c865 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.419426 May 27 09:39:43.817295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 47/114] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:43 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:43.827483 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5acc4312-6e86-4eac-8725-58ca0b501d19 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:43.840249 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5acc4312-6e86-4eac-8725-58ca0b501d19 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:43.840881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b184aad2-81ab-4456-9f37-900b06ef74d9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:43.848631 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b184aad2-81ab-4456-9f37-900b06ef74d9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:43.862827 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5acc4312-6e86-4eac-8725-58ca0b501d19 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:43.864188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5acc4312-6e86-4eac-8725-58ca0b501d19 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.459392 May 27 09:39:43.866716 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b184aad2-81ab-4456-9f37-900b06ef74d9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.867502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 68/115] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:43 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:43.867964 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b184aad2-81ab-4456-9f37-900b06ef74d9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.869376 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b184aad2-81ab-4456-9f37-900b06ef74d9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.871908 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b184aad2-81ab-4456-9f37-900b06ef74d9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:44.087288 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b184aad2-81ab-4456-9f37-900b06ef74d9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:44.095617 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b184aad2-81ab-4456-9f37-900b06ef74d9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.277211 May 27 09:39:44.105903 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 48/116] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:43 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:44.111325 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-5f069eef-087b-45d2-acb1-962612df80d8 req-a0bb4a06-1a1c-4aa0-aaf1-77028b9cb326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2cecc3-140a-45b6-8b02-86784963dcf8", "name": "network-vif-plugged", "status": "completed", "tag": "d50b1a7c-b3da-4b5c-bca2-2cc99a43949e"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:44.147449 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-5f069eef-087b-45d2-acb1-962612df80d8 req-a0bb4a06-1a1c-4aa0-aaf1-77028b9cb326 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:44.147903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-5f069eef-087b-45d2-acb1-962612df80d8 req-a0bb4a06-1a1c-4aa0-aaf1-77028b9cb326 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:44.169677 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-5f069eef-087b-45d2-acb1-962612df80d8 req-a0bb4a06-1a1c-4aa0-aaf1-77028b9cb326 service nova] Creating event network-vif-plugged:d50b1a7c-b3da-4b5c-bca2-2cc99a43949e for instance 7b2cecc3-140a-45b6-8b02-86784963dcf8 on hv-cinder-79760 May 27 09:39:44.180408 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-5f069eef-087b-45d2-acb1-962612df80d8 req-a0bb4a06-1a1c-4aa0-aaf1-77028b9cb326 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073277 May 27 09:39:44.181733 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 69/117] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:39:44.835940 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9c0b2e7e-faec-41aa-a5c9-a991c4d2c6d1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:44.836726 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9c0b2e7e-faec-41aa-a5c9-a991c4d2c6d1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:44.848507 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c0b2e7e-faec-41aa-a5c9-a991c4d2c6d1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:44.848954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c0b2e7e-faec-41aa-a5c9-a991c4d2c6d1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:44.850282 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c0b2e7e-faec-41aa-a5c9-a991c4d2c6d1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:44.850725 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c0b2e7e-faec-41aa-a5c9-a991c4d2c6d1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:44.893145 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-815de11f-3990-4c1a-b00a-465481bfcbcb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:44.894690 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-815de11f-3990-4c1a-b00a-465481bfcbcb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:44.904091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-815de11f-3990-4c1a-b00a-465481bfcbcb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:44.904706 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-815de11f-3990-4c1a-b00a-465481bfcbcb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:44.905631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-815de11f-3990-4c1a-b00a-465481bfcbcb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:44.906245 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-815de11f-3990-4c1a-b00a-465481bfcbcb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.575813 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9c0b2e7e-faec-41aa-a5c9-a991c4d2c6d1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.586649 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9c0b2e7e-faec-41aa-a5c9-a991c4d2c6d1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.755592 May 27 09:39:45.587521 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 49/118] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:44 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:45.593246 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-465d8075-9073-4778-8c9d-698a727f5fea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:45.593246 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-465d8075-9073-4778-8c9d-698a727f5fea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:45.599229 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-465d8075-9073-4778-8c9d-698a727f5fea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.599642 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-465d8075-9073-4778-8c9d-698a727f5fea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.600412 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-465d8075-9073-4778-8c9d-698a727f5fea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.600997 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-465d8075-9073-4778-8c9d-698a727f5fea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.630186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-815de11f-3990-4c1a-b00a-465481bfcbcb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.649707 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-815de11f-3990-4c1a-b00a-465481bfcbcb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.652002 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-815de11f-3990-4c1a-b00a-465481bfcbcb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.653504 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-815de11f-3990-4c1a-b00a-465481bfcbcb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.770749 May 27 09:39:45.654637 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 70/119] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:44 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:45.919675 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-465d8075-9073-4778-8c9d-698a727f5fea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.929841 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-465d8075-9073-4778-8c9d-698a727f5fea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.341514 May 27 09:39:45.930623 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 50/120] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:45 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:46.605082 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bde854de-9407-4786-b9df-ad6d3bd7b72d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:46.605687 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bde854de-9407-4786-b9df-ad6d3bd7b72d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:46.612174 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bde854de-9407-4786-b9df-ad6d3bd7b72d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.612560 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bde854de-9407-4786-b9df-ad6d3bd7b72d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.613315 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bde854de-9407-4786-b9df-ad6d3bd7b72d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.613740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bde854de-9407-4786-b9df-ad6d3bd7b72d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.671946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a889571e-9d99-4370-abcd-d65a3616de5d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:46.672560 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a889571e-9d99-4370-abcd-d65a3616de5d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:46.679985 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a889571e-9d99-4370-abcd-d65a3616de5d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.680658 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a889571e-9d99-4370-abcd-d65a3616de5d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.681442 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a889571e-9d99-4370-abcd-d65a3616de5d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.681877 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a889571e-9d99-4370-abcd-d65a3616de5d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.779171 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bde854de-9407-4786-b9df-ad6d3bd7b72d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:46.788033 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bde854de-9407-4786-b9df-ad6d3bd7b72d tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.186944 May 27 09:39:46.788653 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 71/121] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:46 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:46.854706 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a889571e-9d99-4370-abcd-d65a3616de5d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:46.866714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a889571e-9d99-4370-abcd-d65a3616de5d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:46.868200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a889571e-9d99-4370-abcd-d65a3616de5d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:46.869310 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a889571e-9d99-4370-abcd-d65a3616de5d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.201414 May 27 09:39:46.869862 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 51/122] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:46 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:46.950518 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7208f429-0c40-4ee6-9fb5-94dae3a70ebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:46.951255 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7208f429-0c40-4ee6-9fb5-94dae3a70ebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:46.957697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7208f429-0c40-4ee6-9fb5-94dae3a70ebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.958152 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7208f429-0c40-4ee6-9fb5-94dae3a70ebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.959001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7208f429-0c40-4ee6-9fb5-94dae3a70ebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.959468 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7208f429-0c40-4ee6-9fb5-94dae3a70ebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:47.118169 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7208f429-0c40-4ee6-9fb5-94dae3a70ebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:47.134458 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7208f429-0c40-4ee6-9fb5-94dae3a70ebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.190199 May 27 09:39:47.135068 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 72/123] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:46 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:47.806269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d01408c1-dceb-4ce9-b5cd-3a5b2ee7b096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:47.806881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d01408c1-dceb-4ce9-b5cd-3a5b2ee7b096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:47.813152 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d01408c1-dceb-4ce9-b5cd-3a5b2ee7b096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:47.813578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d01408c1-dceb-4ce9-b5cd-3a5b2ee7b096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:47.814354 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d01408c1-dceb-4ce9-b5cd-3a5b2ee7b096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:47.814794 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d01408c1-dceb-4ce9-b5cd-3a5b2ee7b096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:47.889034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4815e5cd-649b-489d-8554-253bff00d017 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:47.890298 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4815e5cd-649b-489d-8554-253bff00d017 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:47.898256 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4815e5cd-649b-489d-8554-253bff00d017 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:47.898929 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4815e5cd-649b-489d-8554-253bff00d017 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:47.899724 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4815e5cd-649b-489d-8554-253bff00d017 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:47.900370 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4815e5cd-649b-489d-8554-253bff00d017 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:48.014622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d01408c1-dceb-4ce9-b5cd-3a5b2ee7b096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:48.023846 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d01408c1-dceb-4ce9-b5cd-3a5b2ee7b096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.221556 May 27 09:39:48.024853 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 52/124] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:47 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:48.096366 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4815e5cd-649b-489d-8554-253bff00d017 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:48.105538 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4815e5cd-649b-489d-8554-253bff00d017 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:48.107602 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4815e5cd-649b-489d-8554-253bff00d017 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:48.108950 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4815e5cd-649b-489d-8554-253bff00d017 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.225942 May 27 09:39:48.109517 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 73/125] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:47 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:48.152907 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2ff61a2b-0cbc-498c-a303-d279dd32259c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:48.153785 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2ff61a2b-0cbc-498c-a303-d279dd32259c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:48.160826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ff61a2b-0cbc-498c-a303-d279dd32259c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:48.161276 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ff61a2b-0cbc-498c-a303-d279dd32259c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:48.162244 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ff61a2b-0cbc-498c-a303-d279dd32259c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:48.162802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ff61a2b-0cbc-498c-a303-d279dd32259c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:48.338964 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2ff61a2b-0cbc-498c-a303-d279dd32259c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:48.350222 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2ff61a2b-0cbc-498c-a303-d279dd32259c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.202167 May 27 09:39:48.351163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 53/126] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:48 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:49.046264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bb3af2d4-d98f-4c12-b5d2-bc5d8a6680bb tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:49.047521 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bb3af2d4-d98f-4c12-b5d2-bc5d8a6680bb tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:49.055249 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bb3af2d4-d98f-4c12-b5d2-bc5d8a6680bb tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.055783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bb3af2d4-d98f-4c12-b5d2-bc5d8a6680bb tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.056549 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bb3af2d4-d98f-4c12-b5d2-bc5d8a6680bb tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.056982 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bb3af2d4-d98f-4c12-b5d2-bc5d8a6680bb tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.080054 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=100 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:49.127445 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a1e5147a-dc61-4508-a71a-2cc9e507e3a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:49.128040 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a1e5147a-dc61-4508-a71a-2cc9e507e3a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:49.139546 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a1e5147a-dc61-4508-a71a-2cc9e507e3a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.143688 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a1e5147a-dc61-4508-a71a-2cc9e507e3a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.144770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a1e5147a-dc61-4508-a71a-2cc9e507e3a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.145432 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a1e5147a-dc61-4508-a71a-2cc9e507e3a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.277292 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bb3af2d4-d98f-4c12-b5d2-bc5d8a6680bb tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.290440 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bb3af2d4-d98f-4c12-b5d2-bc5d8a6680bb tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.248569 May 27 09:39:49.291468 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 74/127] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:49 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:49.348987 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a1e5147a-dc61-4508-a71a-2cc9e507e3a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.357773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a1e5147a-dc61-4508-a71a-2cc9e507e3a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.359425 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a1e5147a-dc61-4508-a71a-2cc9e507e3a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.362062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a1e5147a-dc61-4508-a71a-2cc9e507e3a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.237938 May 27 09:39:49.362062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 54/128] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:49 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:49.382803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-cf732c82-8920-43ef-a56f-002cdcd95c9c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:49.383457 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-cf732c82-8920-43ef-a56f-002cdcd95c9c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:49.389859 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cf732c82-8920-43ef-a56f-002cdcd95c9c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.390319 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cf732c82-8920-43ef-a56f-002cdcd95c9c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.391090 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cf732c82-8920-43ef-a56f-002cdcd95c9c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.391795 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cf732c82-8920-43ef-a56f-002cdcd95c9c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.541991 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cf732c82-8920-43ef-a56f-002cdcd95c9c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.554631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-cf732c82-8920-43ef-a56f-002cdcd95c9c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1321 microversion: 2.1 time: 0.179466 May 27 09:39:49.555490 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 75/129] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:49 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:50.309048 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9d6d0f90-9382-4057-ba35-f4df909926da tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:50.309650 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9d6d0f90-9382-4057-ba35-f4df909926da tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:50.313956 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:50.317828 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9d6d0f90-9382-4057-ba35-f4df909926da tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.318286 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9d6d0f90-9382-4057-ba35-f4df909926da tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.319076 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9d6d0f90-9382-4057-ba35-f4df909926da tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.319541 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9d6d0f90-9382-4057-ba35-f4df909926da tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.379926 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ad392893-8a11-48ff-bbfe-d132e24f3c8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:50.380726 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ad392893-8a11-48ff-bbfe-d132e24f3c8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:50.386943 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ad392893-8a11-48ff-bbfe-d132e24f3c8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.387704 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ad392893-8a11-48ff-bbfe-d132e24f3c8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.388692 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ad392893-8a11-48ff-bbfe-d132e24f3c8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.389357 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ad392893-8a11-48ff-bbfe-d132e24f3c8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.536141 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9d6d0f90-9382-4057-ba35-f4df909926da tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.551423 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9d6d0f90-9382-4057-ba35-f4df909926da tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.247010 May 27 09:39:50.553866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 55/130] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:50 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:50.568986 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ad392893-8a11-48ff-bbfe-d132e24f3c8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.572168 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-388cc722-5bb7-4d05-9000-5aa78d89cf22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:50.572782 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-388cc722-5bb7-4d05-9000-5aa78d89cf22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:50.577424 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ad392893-8a11-48ff-bbfe-d132e24f3c8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.579680 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ad392893-8a11-48ff-bbfe-d132e24f3c8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.580277 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-388cc722-5bb7-4d05-9000-5aa78d89cf22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.580787 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-388cc722-5bb7-4d05-9000-5aa78d89cf22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.581468 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ad392893-8a11-48ff-bbfe-d132e24f3c8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.205355 May 27 09:39:50.581709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-388cc722-5bb7-4d05-9000-5aa78d89cf22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.582226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-388cc722-5bb7-4d05-9000-5aa78d89cf22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.582832 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 76/131] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:50 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:50.741648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-388cc722-5bb7-4d05-9000-5aa78d89cf22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.754946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-388cc722-5bb7-4d05-9000-5aa78d89cf22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1515 microversion: 2.1 time: 0.186940 May 27 09:39:50.756024 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 56/132] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:50 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:50.772943 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a404a6db-22ce-485d-a344-cf9a358ebef3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:50.774146 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a404a6db-22ce-485d-a344-cf9a358ebef3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:50.781207 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a404a6db-22ce-485d-a344-cf9a358ebef3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.781938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a404a6db-22ce-485d-a344-cf9a358ebef3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.782936 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a404a6db-22ce-485d-a344-cf9a358ebef3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.783719 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a404a6db-22ce-485d-a344-cf9a358ebef3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.855084 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-a404a6db-22ce-485d-a344-cf9a358ebef3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lazy-loading 'flavor' on Instance uuid 7b2cecc3-140a-45b6-8b02-86784963dcf8 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:39:51.154887 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a404a6db-22ce-485d-a344-cf9a358ebef3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8/action" status: 200 len: 32 microversion: 2.1 time: 0.385994 May 27 09:39:51.159564 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 77/133] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:39:50 2022] POST /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8/action => generated 32 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:39:51.165547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-aa43054e-79da-4f50-8efd-af2ac2dd574f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:51.166169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-aa43054e-79da-4f50-8efd-af2ac2dd574f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:51.172178 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aa43054e-79da-4f50-8efd-af2ac2dd574f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.173334 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aa43054e-79da-4f50-8efd-af2ac2dd574f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.174275 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aa43054e-79da-4f50-8efd-af2ac2dd574f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.174876 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aa43054e-79da-4f50-8efd-af2ac2dd574f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.179188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:51.322504 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-aa43054e-79da-4f50-8efd-af2ac2dd574f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.331058 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-aa43054e-79da-4f50-8efd-af2ac2dd574f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.170195 May 27 09:39:51.331678 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 57/134] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:51 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:51.570773 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-026d13cc-5ba1-41c2-9d5b-f437eed26fa1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:51.571378 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-026d13cc-5ba1-41c2-9d5b-f437eed26fa1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:51.577702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-026d13cc-5ba1-41c2-9d5b-f437eed26fa1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.578148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-026d13cc-5ba1-41c2-9d5b-f437eed26fa1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.578915 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-026d13cc-5ba1-41c2-9d5b-f437eed26fa1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.579421 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-026d13cc-5ba1-41c2-9d5b-f437eed26fa1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.600981 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-09e50455-7b00-4500-8a85-b5a54ba14572 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:51.601698 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-09e50455-7b00-4500-8a85-b5a54ba14572 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:51.607795 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-09e50455-7b00-4500-8a85-b5a54ba14572 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.608673 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-09e50455-7b00-4500-8a85-b5a54ba14572 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.609663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-09e50455-7b00-4500-8a85-b5a54ba14572 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.610857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-09e50455-7b00-4500-8a85-b5a54ba14572 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.798513 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-09e50455-7b00-4500-8a85-b5a54ba14572 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.799366 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-026d13cc-5ba1-41c2-9d5b-f437eed26fa1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.807598 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-09e50455-7b00-4500-8a85-b5a54ba14572 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.809106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-09e50455-7b00-4500-8a85-b5a54ba14572 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.810224 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-09e50455-7b00-4500-8a85-b5a54ba14572 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.213681 May 27 09:39:51.810965 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 58/135] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:51 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:51.822276 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-026d13cc-5ba1-41c2-9d5b-f437eed26fa1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.255865 May 27 09:39:51.822965 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 78/136] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:51 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:52.347817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-39262d46-0356-4efc-967c-5db9e36161eb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:52.348620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-39262d46-0356-4efc-967c-5db9e36161eb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:52.355319 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39262d46-0356-4efc-967c-5db9e36161eb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.355799 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39262d46-0356-4efc-967c-5db9e36161eb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.356564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39262d46-0356-4efc-967c-5db9e36161eb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.356998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39262d46-0356-4efc-967c-5db9e36161eb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.490509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-39262d46-0356-4efc-967c-5db9e36161eb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:52.498325 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-39262d46-0356-4efc-967c-5db9e36161eb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.154311 May 27 09:39:52.498874 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 59/137] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:52 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:52.829201 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-29563f3e-dacc-4cd9-9556-3a5f1ef0d366 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:52.830014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-29563f3e-dacc-4cd9-9556-3a5f1ef0d366 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:52.838961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-29563f3e-dacc-4cd9-9556-3a5f1ef0d366 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.841931 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-29563f3e-dacc-4cd9-9556-3a5f1ef0d366 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.842969 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-29563f3e-dacc-4cd9-9556-3a5f1ef0d366 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.846191 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-12033a28-b6fc-4acb-8893-9414f4dfb7a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:52.846710 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-29563f3e-dacc-4cd9-9556-3a5f1ef0d366 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.846831 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-12033a28-b6fc-4acb-8893-9414f4dfb7a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:52.855637 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-12033a28-b6fc-4acb-8893-9414f4dfb7a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.856097 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-12033a28-b6fc-4acb-8893-9414f4dfb7a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.856890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-12033a28-b6fc-4acb-8893-9414f4dfb7a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.857334 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-12033a28-b6fc-4acb-8893-9414f4dfb7a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:53.083385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-29563f3e-dacc-4cd9-9556-3a5f1ef0d366 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:53.089305 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-12033a28-b6fc-4acb-8893-9414f4dfb7a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:53.091424 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-29563f3e-dacc-4cd9-9556-3a5f1ef0d366 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:53.102696 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-12033a28-b6fc-4acb-8893-9414f4dfb7a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.258883 May 27 09:39:53.102696 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 60/138] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:52 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:53.105762 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-29563f3e-dacc-4cd9-9556-3a5f1ef0d366 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:53.107098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-29563f3e-dacc-4cd9-9556-3a5f1ef0d366 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.282267 May 27 09:39:53.107842 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 79/139] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:52 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:53.515262 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8d5e68a1-b164-4212-9c59-20523f479914 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:53.515808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8d5e68a1-b164-4212-9c59-20523f479914 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:53.523172 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8d5e68a1-b164-4212-9c59-20523f479914 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:53.523647 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8d5e68a1-b164-4212-9c59-20523f479914 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:53.524470 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8d5e68a1-b164-4212-9c59-20523f479914 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:53.524903 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8d5e68a1-b164-4212-9c59-20523f479914 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:53.655364 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8d5e68a1-b164-4212-9c59-20523f479914 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:53.663989 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8d5e68a1-b164-4212-9c59-20523f479914 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.152590 May 27 09:39:53.664576 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 61/140] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:53 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:54.113725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8f46f351-d2ee-4bd9-8b26-cb4338204627 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:54.114451 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8f46f351-d2ee-4bd9-8b26-cb4338204627 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:54.120506 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f46f351-d2ee-4bd9-8b26-cb4338204627 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.121186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f46f351-d2ee-4bd9-8b26-cb4338204627 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:54.122212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f46f351-d2ee-4bd9-8b26-cb4338204627 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.122643 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f46f351-d2ee-4bd9-8b26-cb4338204627 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:54.128399 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f1e0f3e9-bca8-4f1b-bd84-87532338884a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:54.132205 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f1e0f3e9-bca8-4f1b-bd84-87532338884a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:54.159892 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f1e0f3e9-bca8-4f1b-bd84-87532338884a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.160339 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f1e0f3e9-bca8-4f1b-bd84-87532338884a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:54.168531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f1e0f3e9-bca8-4f1b-bd84-87532338884a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.169512 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f1e0f3e9-bca8-4f1b-bd84-87532338884a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:54.466856 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8f46f351-d2ee-4bd9-8b26-cb4338204627 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:54.466985 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f1e0f3e9-bca8-4f1b-bd84-87532338884a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:54.475617 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8f46f351-d2ee-4bd9-8b26-cb4338204627 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.365657 May 27 09:39:54.476282 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 80/141] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:54 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:54.476695 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f1e0f3e9-bca8-4f1b-bd84-87532338884a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:54.478919 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f1e0f3e9-bca8-4f1b-bd84-87532338884a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:54.480089 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f1e0f3e9-bca8-4f1b-bd84-87532338884a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.356717 May 27 09:39:54.480655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 62/142] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:54 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:54.490382 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-10d959ac-b48b-4b30-92fc-33d29be7de78 req-8570fcbb-3761-4335-9c39-d69bc1bf1670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7937af8-bbeb-4a70-bd98-1062cbe0d4c7", "name": "network-vif-plugged", "status": "completed", "tag": "6328b701-4055-487d-8cef-ec0bdfa4ceda"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:54.500401 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-10d959ac-b48b-4b30-92fc-33d29be7de78 req-8570fcbb-3761-4335-9c39-d69bc1bf1670 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.501371 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-10d959ac-b48b-4b30-92fc-33d29be7de78 req-8570fcbb-3761-4335-9c39-d69bc1bf1670 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:54.512937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-10d959ac-b48b-4b30-92fc-33d29be7de78 req-8570fcbb-3761-4335-9c39-d69bc1bf1670 service nova] Creating event network-vif-plugged:6328b701-4055-487d-8cef-ec0bdfa4ceda for instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 on hv-cinder-79760 May 27 09:39:54.520314 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-10d959ac-b48b-4b30-92fc-33d29be7de78 req-8570fcbb-3761-4335-9c39-d69bc1bf1670 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042666 May 27 09:39:54.523008 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 81/143] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:54.681091 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2950b78d-f1c6-4070-8a57-f0a3908c4373 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:54.681732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2950b78d-f1c6-4070-8a57-f0a3908c4373 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:54.689027 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2950b78d-f1c6-4070-8a57-f0a3908c4373 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.689473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2950b78d-f1c6-4070-8a57-f0a3908c4373 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:54.690248 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2950b78d-f1c6-4070-8a57-f0a3908c4373 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.690722 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2950b78d-f1c6-4070-8a57-f0a3908c4373 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.018891 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2950b78d-f1c6-4070-8a57-f0a3908c4373 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:55.046504 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2950b78d-f1c6-4070-8a57-f0a3908c4373 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.369353 May 27 09:39:55.057210 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 63/144] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:54 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:55.496746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0ccd8688-4de1-4145-abb6-88c66c34af63 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:55.497590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0ccd8688-4de1-4145-abb6-88c66c34af63 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:55.498080 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7fcbcd0b-e225-422c-be0c-5857fd5e900c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:55.499258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7fcbcd0b-e225-422c-be0c-5857fd5e900c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:55.507879 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fcbcd0b-e225-422c-be0c-5857fd5e900c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.508828 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fcbcd0b-e225-422c-be0c-5857fd5e900c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.509219 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ccd8688-4de1-4145-abb6-88c66c34af63 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.509672 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ccd8688-4de1-4145-abb6-88c66c34af63 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.510374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fcbcd0b-e225-422c-be0c-5857fd5e900c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.510482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ccd8688-4de1-4145-abb6-88c66c34af63 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.510872 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ccd8688-4de1-4145-abb6-88c66c34af63 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.511680 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fcbcd0b-e225-422c-be0c-5857fd5e900c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.134161 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7fcbcd0b-e225-422c-be0c-5857fd5e900c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.166266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7fcbcd0b-e225-422c-be0c-5857fd5e900c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.181131 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7fcbcd0b-e225-422c-be0c-5857fd5e900c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.182440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7fcbcd0b-e225-422c-be0c-5857fd5e900c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.688211 May 27 09:39:56.189416 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 64/145] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:55 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:56.216811 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d0b64796-1d07-4c22-a83f-6deaf7b0ed47 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:56.218103 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d0b64796-1d07-4c22-a83f-6deaf7b0ed47 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:56.246826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d0b64796-1d07-4c22-a83f-6deaf7b0ed47 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.250193 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d0b64796-1d07-4c22-a83f-6deaf7b0ed47 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.252797 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d0b64796-1d07-4c22-a83f-6deaf7b0ed47 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.254104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d0b64796-1d07-4c22-a83f-6deaf7b0ed47 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.359509 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0ccd8688-4de1-4145-abb6-88c66c34af63 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.380086 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0ccd8688-4de1-4145-abb6-88c66c34af63 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.884488 May 27 09:39:56.383716 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 82/146] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:55 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:56.828026 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d0b64796-1d07-4c22-a83f-6deaf7b0ed47 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.838839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d0b64796-1d07-4c22-a83f-6deaf7b0ed47 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.633212 May 27 09:39:56.839475 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 65/147] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:56 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:57.210612 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6005ba3c-a7bb-40c8-8a7c-b8aaf60a4ace tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:57.211133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6005ba3c-a7bb-40c8-8a7c-b8aaf60a4ace tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:57.230647 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6005ba3c-a7bb-40c8-8a7c-b8aaf60a4ace tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.231126 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6005ba3c-a7bb-40c8-8a7c-b8aaf60a4ace tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.231984 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6005ba3c-a7bb-40c8-8a7c-b8aaf60a4ace tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.232422 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6005ba3c-a7bb-40c8-8a7c-b8aaf60a4ace tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.322477 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1227e94c-c059-4029-9c3b-d50e7449e6cc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:57.324080 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1227e94c-c059-4029-9c3b-d50e7449e6cc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:57.333190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1227e94c-c059-4029-9c3b-d50e7449e6cc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.335754 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1227e94c-c059-4029-9c3b-d50e7449e6cc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.336607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1227e94c-c059-4029-9c3b-d50e7449e6cc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.338673 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1227e94c-c059-4029-9c3b-d50e7449e6cc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.390087 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1227e94c-c059-4029-9c3b-d50e7449e6cc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:39:57.493280 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6005ba3c-a7bb-40c8-8a7c-b8aaf60a4ace tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.508285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6005ba3c-a7bb-40c8-8a7c-b8aaf60a4ace tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.510349 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6005ba3c-a7bb-40c8-8a7c-b8aaf60a4ace tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.512421 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6005ba3c-a7bb-40c8-8a7c-b8aaf60a4ace tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.305914 May 27 09:39:57.513352 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 83/148] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:57 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:57.519330 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-99bcec3a-de05-4ae9-9d51-4f15fd0adf31 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:57.520783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-99bcec3a-de05-4ae9-9d51-4f15fd0adf31 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:57.529702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=90 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:57.532511 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-99bcec3a-de05-4ae9-9d51-4f15fd0adf31 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.533344 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-99bcec3a-de05-4ae9-9d51-4f15fd0adf31 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.534949 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-99bcec3a-de05-4ae9-9d51-4f15fd0adf31 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.536611 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-99bcec3a-de05-4ae9-9d51-4f15fd0adf31 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.606463 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1227e94c-c059-4029-9c3b-d50e7449e6cc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "DELETE /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 204 len: 0 microversion: 2.1 time: 0.288095 May 27 09:39:57.607864 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 66/149] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:39:57 2022] DELETE /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:39:57.623004 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ecd473d5-808b-4313-b54e-dd1bfc4ca3a2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:57.623862 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ecd473d5-808b-4313-b54e-dd1bfc4ca3a2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:57.630611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ecd473d5-808b-4313-b54e-dd1bfc4ca3a2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.631075 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ecd473d5-808b-4313-b54e-dd1bfc4ca3a2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.636186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ecd473d5-808b-4313-b54e-dd1bfc4ca3a2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.636860 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ecd473d5-808b-4313-b54e-dd1bfc4ca3a2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.862164 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ecd473d5-808b-4313-b54e-dd1bfc4ca3a2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.866600 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-99bcec3a-de05-4ae9-9d51-4f15fd0adf31 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.881583 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-99bcec3a-de05-4ae9-9d51-4f15fd0adf31 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.366131 May 27 09:39:57.883310 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ecd473d5-808b-4313-b54e-dd1bfc4ca3a2 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1553 microversion: 2.1 time: 0.266621 May 27 09:39:57.884387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 84/150] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:57 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:57.885496 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 67/151] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:57 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1553 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:57.908567 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ec2aebac-3e71-4489-a356-d0d9fb4412bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:57.910591 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ec2aebac-3e71-4489-a356-d0d9fb4412bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:57.920633 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ec2aebac-3e71-4489-a356-d0d9fb4412bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.921098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ec2aebac-3e71-4489-a356-d0d9fb4412bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.921901 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ec2aebac-3e71-4489-a356-d0d9fb4412bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.922339 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ec2aebac-3e71-4489-a356-d0d9fb4412bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.190384 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ec2aebac-3e71-4489-a356-d0d9fb4412bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:58.198541 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ec2aebac-3e71-4489-a356-d0d9fb4412bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.297283 May 27 09:39:58.199125 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 85/152] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:57 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:58.530353 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e53c4be2-aa9c-4470-b2f1-a7d3065f5051 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:58.531659 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e53c4be2-aa9c-4470-b2f1-a7d3065f5051 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:58.539460 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e53c4be2-aa9c-4470-b2f1-a7d3065f5051 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.540126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e53c4be2-aa9c-4470-b2f1-a7d3065f5051 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.541189 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e53c4be2-aa9c-4470-b2f1-a7d3065f5051 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.541819 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e53c4be2-aa9c-4470-b2f1-a7d3065f5051 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.777438 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e53c4be2-aa9c-4470-b2f1-a7d3065f5051 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:58.787293 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e53c4be2-aa9c-4470-b2f1-a7d3065f5051 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:58.789573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e53c4be2-aa9c-4470-b2f1-a7d3065f5051 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:58.792167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e53c4be2-aa9c-4470-b2f1-a7d3065f5051 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.265987 May 27 09:39:58.793383 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 68/153] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:58 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:58.901940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-64fd33c6-54e3-45fb-9c32-8ecfba8221d6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:58.902555 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-64fd33c6-54e3-45fb-9c32-8ecfba8221d6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:58.909155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-64fd33c6-54e3-45fb-9c32-8ecfba8221d6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.909940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-64fd33c6-54e3-45fb-9c32-8ecfba8221d6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.910849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-64fd33c6-54e3-45fb-9c32-8ecfba8221d6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.911502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-64fd33c6-54e3-45fb-9c32-8ecfba8221d6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.911688 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-06d617f5-4565-497b-93e8-24b7db6ce0ba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:58.912307 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-06d617f5-4565-497b-93e8-24b7db6ce0ba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:58.920851 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-06d617f5-4565-497b-93e8-24b7db6ce0ba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.921298 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-06d617f5-4565-497b-93e8-24b7db6ce0ba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.922075 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-06d617f5-4565-497b-93e8-24b7db6ce0ba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.925753 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-06d617f5-4565-497b-93e8-24b7db6ce0ba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:59.101109 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-64fd33c6-54e3-45fb-9c32-8ecfba8221d6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:59.112029 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-64fd33c6-54e3-45fb-9c32-8ecfba8221d6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.213820 May 27 09:39:59.114030 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 86/154] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:58 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:59.125455 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-cddef2a0-ead3-4534-9e8c-9c539361cafb req-fbe045a4-7323-46b1-859b-b4ebc82863d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c817de-8115-43f6-9a05-6366318ea29f", "name": "network-vif-plugged", "status": "completed", "tag": "170fc0f5-d663-45e7-aca9-b414a735e887"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:59.138316 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-cddef2a0-ead3-4534-9e8c-9c539361cafb req-fbe045a4-7323-46b1-859b-b4ebc82863d5 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:59.139014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-cddef2a0-ead3-4534-9e8c-9c539361cafb req-fbe045a4-7323-46b1-859b-b4ebc82863d5 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:59.152405 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-cddef2a0-ead3-4534-9e8c-9c539361cafb req-fbe045a4-7323-46b1-859b-b4ebc82863d5 service nova] Creating event network-vif-plugged:170fc0f5-d663-45e7-aca9-b414a735e887 for instance d5c817de-8115-43f6-9a05-6366318ea29f on hv-cinder-79760 May 27 09:39:59.161646 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-06d617f5-4565-497b-93e8-24b7db6ce0ba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:59.167260 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-cddef2a0-ead3-4534-9e8c-9c539361cafb req-fbe045a4-7323-46b1-859b-b4ebc82863d5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048750 May 27 09:39:59.168795 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 87/155] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:59.171146 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-06d617f5-4565-497b-93e8-24b7db6ce0ba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1553 microversion: 2.1 time: 0.263925 May 27 09:39:59.171769 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 69/156] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:58 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1553 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:59.216149 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-aa494cf3-aefc-48bf-b9a5-db47e937b86a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:59.216842 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-aa494cf3-aefc-48bf-b9a5-db47e937b86a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:59.223241 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa494cf3-aefc-48bf-b9a5-db47e937b86a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:59.223714 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa494cf3-aefc-48bf-b9a5-db47e937b86a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:59.224478 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa494cf3-aefc-48bf-b9a5-db47e937b86a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:59.224910 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa494cf3-aefc-48bf-b9a5-db47e937b86a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:59.389925 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-aa494cf3-aefc-48bf-b9a5-db47e937b86a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:59.398756 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-aa494cf3-aefc-48bf-b9a5-db47e937b86a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.186987 May 27 09:39:59.399669 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 88/157] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:39:59 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:59.809946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6b72a603-1f95-43e6-8f42-7057c574fccc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:59.810552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6b72a603-1f95-43e6-8f42-7057c574fccc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:59.817169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6b72a603-1f95-43e6-8f42-7057c574fccc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:59.817620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6b72a603-1f95-43e6-8f42-7057c574fccc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:59.818389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6b72a603-1f95-43e6-8f42-7057c574fccc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:59.818987 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6b72a603-1f95-43e6-8f42-7057c574fccc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.108114 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6b72a603-1f95-43e6-8f42-7057c574fccc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.118384 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6b72a603-1f95-43e6-8f42-7057c574fccc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.128670 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6b72a603-1f95-43e6-8f42-7057c574fccc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.133112 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6b72a603-1f95-43e6-8f42-7057c574fccc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1406 microversion: 2.20 time: 0.325436 May 27 09:40:00.133870 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 70/158] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:39:59 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:00.134940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9b6b9a66-5c66-461c-a7f9-a189148b13bd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:00.135774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9b6b9a66-5c66-461c-a7f9-a189148b13bd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:00.145204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9b6b9a66-5c66-461c-a7f9-a189148b13bd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.147786 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9b6b9a66-5c66-461c-a7f9-a189148b13bd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.148943 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9b6b9a66-5c66-461c-a7f9-a189148b13bd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.149523 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9b6b9a66-5c66-461c-a7f9-a189148b13bd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.189153 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7c8fb1f1-d6d4-453b-adb7-8d707aefe928 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:00.190349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7c8fb1f1-d6d4-453b-adb7-8d707aefe928 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:00.204801 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7c8fb1f1-d6d4-453b-adb7-8d707aefe928 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.205265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7c8fb1f1-d6d4-453b-adb7-8d707aefe928 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.206052 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7c8fb1f1-d6d4-453b-adb7-8d707aefe928 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.206520 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7c8fb1f1-d6d4-453b-adb7-8d707aefe928 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.503659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9b6b9a66-5c66-461c-a7f9-a189148b13bd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.515569 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9b6b9a66-5c66-461c-a7f9-a189148b13bd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.387065 May 27 09:40:00.521297 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7c8fb1f1-d6d4-453b-adb7-8d707aefe928 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.528789 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 89/159] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:00 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:00.533163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7c8fb1f1-d6d4-453b-adb7-8d707aefe928 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1553 microversion: 2.1 time: 0.348873 May 27 09:40:00.533749 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 71/160] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:00 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1553 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:00.535285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c523263f-6883-47e9-97a5-2df755abd3a8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:00.535993 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c523263f-6883-47e9-97a5-2df755abd3a8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:00.543012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c523263f-6883-47e9-97a5-2df755abd3a8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.543814 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c523263f-6883-47e9-97a5-2df755abd3a8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.544902 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c523263f-6883-47e9-97a5-2df755abd3a8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.545706 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c523263f-6883-47e9-97a5-2df755abd3a8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.567916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:00.745138 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c523263f-6883-47e9-97a5-2df755abd3a8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.754599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c523263f-6883-47e9-97a5-2df755abd3a8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.224458 May 27 09:40:00.764267 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 90/161] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:00 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:01.151980 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ce32e2a1-1c58-4ff7-b903-633d66243f2b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:01.152583 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ce32e2a1-1c58-4ff7-b903-633d66243f2b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:01.158961 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ce32e2a1-1c58-4ff7-b903-633d66243f2b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.162607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ce32e2a1-1c58-4ff7-b903-633d66243f2b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.163502 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ce32e2a1-1c58-4ff7-b903-633d66243f2b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.163950 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ce32e2a1-1c58-4ff7-b903-633d66243f2b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.169099 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:01.531727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ce32e2a1-1c58-4ff7-b903-633d66243f2b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:01.536824 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-864017f9-1346-46e3-88ac-01418766ca6b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:01.537882 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-864017f9-1346-46e3-88ac-01418766ca6b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:01.557295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ce32e2a1-1c58-4ff7-b903-633d66243f2b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:01.561950 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-864017f9-1346-46e3-88ac-01418766ca6b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.562616 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-864017f9-1346-46e3-88ac-01418766ca6b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.564819 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-864017f9-1346-46e3-88ac-01418766ca6b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.566434 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ce32e2a1-1c58-4ff7-b903-633d66243f2b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:01.568015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-864017f9-1346-46e3-88ac-01418766ca6b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.569607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ce32e2a1-1c58-4ff7-b903-633d66243f2b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1597 microversion: 2.20 time: 0.421017 May 27 09:40:01.570288 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 72/162] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:40:01 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1597 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:01.582034 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0827caf7-ecdc-4126-b468-efa9aa49bddf tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:01.582646 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0827caf7-ecdc-4126-b468-efa9aa49bddf tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:01.597402 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0827caf7-ecdc-4126-b468-efa9aa49bddf tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.598508 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0827caf7-ecdc-4126-b468-efa9aa49bddf tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.602289 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0827caf7-ecdc-4126-b468-efa9aa49bddf tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.602735 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0827caf7-ecdc-4126-b468-efa9aa49bddf tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.210555 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-864017f9-1346-46e3-88ac-01418766ca6b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:02.216064 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0827caf7-ecdc-4126-b468-efa9aa49bddf tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:02.229755 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0827caf7-ecdc-4126-b468-efa9aa49bddf tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1553 microversion: 2.1 time: 0.657248 May 27 09:40:02.231765 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-864017f9-1346-46e3-88ac-01418766ca6b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.698303 May 27 09:40:02.242541 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 91/163] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:01 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:02.242625 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 73/164] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:01 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1553 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:02.242696 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a5973f50-a012-429f-b49a-d0001b2cd41a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:02.242696 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a5973f50-a012-429f-b49a-d0001b2cd41a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:02.249337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a5973f50-a012-429f-b49a-d0001b2cd41a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.249964 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a5973f50-a012-429f-b49a-d0001b2cd41a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.251119 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a5973f50-a012-429f-b49a-d0001b2cd41a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.251731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a5973f50-a012-429f-b49a-d0001b2cd41a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.265587 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5fd24a70-1d43-4f9e-b87d-039be8ac1225 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:02.266738 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5fd24a70-1d43-4f9e-b87d-039be8ac1225 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:02.289921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5fd24a70-1d43-4f9e-b87d-039be8ac1225 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.290379 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5fd24a70-1d43-4f9e-b87d-039be8ac1225 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.291150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5fd24a70-1d43-4f9e-b87d-039be8ac1225 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.291610 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5fd24a70-1d43-4f9e-b87d-039be8ac1225 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.478798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a5973f50-a012-429f-b49a-d0001b2cd41a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.243252 May 27 09:40:02.479850 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 92/165] 10.222.0.41 () {60 vars in 1315 bytes} [Fri May 27 09:40:02 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-interface => generated 284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:40:02.615541 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5fd24a70-1d43-4f9e-b87d-039be8ac1225 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:02.649870 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5fd24a70-1d43-4f9e-b87d-039be8ac1225 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.405948 May 27 09:40:02.649870 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 74/166] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:02 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:02.888561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-b36eb620-b321-482a-8228-89e43510f160 req-92945938-11d2-4ce3-87df-c9dbf3eab468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415b9b30-f34e-4800-a994-d0d7cb7344e5", "name": "network-vif-deleted", "tag": "91c5ca83-bcb7-4dd6-8333-c29ae094c13b"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:02.897740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-b36eb620-b321-482a-8228-89e43510f160 req-92945938-11d2-4ce3-87df-c9dbf3eab468 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.898491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-b36eb620-b321-482a-8228-89e43510f160 req-92945938-11d2-4ce3-87df-c9dbf3eab468 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.911629 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-b36eb620-b321-482a-8228-89e43510f160 req-92945938-11d2-4ce3-87df-c9dbf3eab468 service nova] Creating event network-vif-deleted:91c5ca83-bcb7-4dd6-8333-c29ae094c13b for instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 on hv-cinder-79760 May 27 09:40:02.917688 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-b36eb620-b321-482a-8228-89e43510f160 req-92945938-11d2-4ce3-87df-c9dbf3eab468 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032804 May 27 09:40:02.918892 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 93/167] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:03.258721 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c340e093-118d-483e-b009-604d945dcdba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:03.259909 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c340e093-118d-483e-b009-604d945dcdba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:03.261901 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-911e43fc-0cb3-44e6-b5b0-198c52c8e241 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:03.263106 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-911e43fc-0cb3-44e6-b5b0-198c52c8e241 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:03.296256 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c340e093-118d-483e-b009-604d945dcdba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.298454 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-911e43fc-0cb3-44e6-b5b0-198c52c8e241 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.299851 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c340e093-118d-483e-b009-604d945dcdba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.300538 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-911e43fc-0cb3-44e6-b5b0-198c52c8e241 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.301563 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c340e093-118d-483e-b009-604d945dcdba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.302596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-911e43fc-0cb3-44e6-b5b0-198c52c8e241 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.303266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c340e093-118d-483e-b009-604d945dcdba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.304667 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-911e43fc-0cb3-44e6-b5b0-198c52c8e241 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.416792 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c340e093-118d-483e-b009-604d945dcdba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:03.434869 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c340e093-118d-483e-b009-604d945dcdba tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1511 microversion: 2.1 time: 0.186247 May 27 09:40:03.436018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 75/168] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:03 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:03.549457 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-911e43fc-0cb3-44e6-b5b0-198c52c8e241 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:03.557871 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-911e43fc-0cb3-44e6-b5b0-198c52c8e241 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1362 microversion: 2.1 time: 0.310227 May 27 09:40:03.558832 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 94/169] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:03 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:03.674148 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7e21edb2-04fa-48a8-a7b6-390a9c11c5b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:03.675242 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7e21edb2-04fa-48a8-a7b6-390a9c11c5b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:03.685649 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7e21edb2-04fa-48a8-a7b6-390a9c11c5b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.686542 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7e21edb2-04fa-48a8-a7b6-390a9c11c5b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.687991 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7e21edb2-04fa-48a8-a7b6-390a9c11c5b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.688885 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7e21edb2-04fa-48a8-a7b6-390a9c11c5b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.871784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7e21edb2-04fa-48a8-a7b6-390a9c11c5b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:03.881387 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7e21edb2-04fa-48a8-a7b6-390a9c11c5b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.213607 May 27 09:40:03.882779 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 76/170] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:03 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:04.164019 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-654820730", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "networks": [{"uuid": "bc3314c2-6f7a-4cfb-97c0-f4db7429a577"}]}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:04.250943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-e93facdc-2540-4328-99bc-2a3ffeaff39a req-f0e34df3-f6a6-4d98-b39a-c9eddd472b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7937af8-bbeb-4a70-bd98-1062cbe0d4c7", "tag": "6328b701-4055-487d-8cef-ec0bdfa4ceda"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:04.262167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] validate_networks() for [('bc3314c2-6f7a-4cfb-97c0-f4db7429a577', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:40:04.264395 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-e93facdc-2540-4328-99bc-2a3ffeaff39a req-f0e34df3-f6a6-4d98-b39a-c9eddd472b49 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.265783 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-e93facdc-2540-4328-99bc-2a3ffeaff39a req-f0e34df3-f6a6-4d98-b39a-c9eddd472b49 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.278186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-e93facdc-2540-4328-99bc-2a3ffeaff39a req-f0e34df3-f6a6-4d98-b39a-c9eddd472b49 service nova] Creating event network-changed:6328b701-4055-487d-8cef-ec0bdfa4ceda for instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 on hv-cinder-79760 May 27 09:40:04.284615 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-e93facdc-2540-4328-99bc-2a3ffeaff39a req-f0e34df3-f6a6-4d98-b39a-c9eddd472b49 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037321 May 27 09:40:04.285224 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 77/171] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:04.453869 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:04.454843 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:04.462798 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.463476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.464410 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.464995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.500992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.501615 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.502152 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lazy-loading 'fault' on Instance uuid 415b9b30-f34e-4800-a994-d0d7cb7344e5 {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:40:04.567668 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:04.584168 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ba13cfcd-72d3-4b20-98fc-94d206b9f452 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1351 microversion: 2.1 time: 0.135292 May 27 09:40:04.585484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 78/172] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:04 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:04.607566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-45b92b8b-3b0d-410b-8043-18398fcc37ac tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:04.608195 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-45b92b8b-3b0d-410b-8043-18398fcc37ac tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:04.627569 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-45b92b8b-3b0d-410b-8043-18398fcc37ac tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.628048 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-45b92b8b-3b0d-410b-8043-18398fcc37ac tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.628825 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-45b92b8b-3b0d-410b-8043-18398fcc37ac tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.629266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-45b92b8b-3b0d-410b-8043-18398fcc37ac tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.753885 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:40:04.754294 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:40:04.754757 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:40:04.755328 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:40:04.756165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:40:04.773803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.774301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.775322 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.776074 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.796657 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Getting quotas for project 4b17fac30e6a469a8e0ca8b6e2fcdc1d. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:40:04.801202 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Getting quotas for user b35535c6b1c74a0baf58c8ccdbf30772 and project 4b17fac30e6a469a8e0ca8b6e2fcdc1d. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:40:04.814300 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:40:04.817436 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:40:04.838206 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-45b92b8b-3b0d-410b-8043-18398fcc37ac tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:04.865314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-45b92b8b-3b0d-410b-8043-18398fcc37ac tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1548 microversion: 2.1 time: 0.276997 May 27 09:40:04.868747 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 79/173] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:04 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1548 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:04.882996 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-75eb0b1c-c9b3-4213-9614-38d1a92be95b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:04.883779 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-75eb0b1c-c9b3-4213-9614-38d1a92be95b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:04.889661 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1d1b49fb-ec74-480f-b72b-49484d56ddd9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730935 May 27 09:40:04.896882 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 95/174] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:40:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 09:40:04.897460 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-75eb0b1c-c9b3-4213-9614-38d1a92be95b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.898209 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-75eb0b1c-c9b3-4213-9614-38d1a92be95b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.899189 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-75eb0b1c-c9b3-4213-9614-38d1a92be95b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.899802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-75eb0b1c-c9b3-4213-9614-38d1a92be95b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.899935 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bef4555d-8631-4cfe-a34c-be6cc797b102 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:04.900775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bef4555d-8631-4cfe-a34c-be6cc797b102 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:04.916548 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bef4555d-8631-4cfe-a34c-be6cc797b102 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.916548 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bef4555d-8631-4cfe-a34c-be6cc797b102 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.917222 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bef4555d-8631-4cfe-a34c-be6cc797b102 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.917718 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bef4555d-8631-4cfe-a34c-be6cc797b102 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:05.029473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-75eb0b1c-c9b3-4213-9614-38d1a92be95b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150237 May 27 09:40:05.030164 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 80/175] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 09:40:04 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:40:05.036103 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dddad661-f52d-44cc-8863-3915f95c2d4c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:05.037589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dddad661-f52d-44cc-8863-3915f95c2d4c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:05.197593 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dddad661-f52d-44cc-8863-3915f95c2d4c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:05.209090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dddad661-f52d-44cc-8863-3915f95c2d4c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1213 microversion: 2.1 time: 0.177512 May 27 09:40:05.209857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 81/176] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:05 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:05.288052 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bef4555d-8631-4cfe-a34c-be6cc797b102 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:05.304372 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bef4555d-8631-4cfe-a34c-be6cc797b102 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.409186 May 27 09:40:05.305397 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 96/177] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:04 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:05.601809 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:05.603223 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:05.611220 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:05.611964 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:05.613114 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:05.617223 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:05.718016 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:05.718467 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:05.718921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lazy-loading 'fault' on Instance uuid 415b9b30-f34e-4800-a994-d0d7cb7344e5 {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:40:05.816439 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31b5e67d2ac4b80bf16a766a7f9f423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7479df6fb46a412398b2e1749b0cbd96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:05.825416 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c5a45ba7-0336-4128-b508-fbc6b278e679 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 200 len: 1305 microversion: 2.1 time: 0.227716 May 27 09:40:05.831640 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 82/178] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:05 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 1305 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:06.234959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-17cf8c6a-5cfc-4f40-be51-a3c8eade1e88 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:06.235634 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-17cf8c6a-5cfc-4f40-be51-a3c8eade1e88 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:06.243126 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-17cf8c6a-5cfc-4f40-be51-a3c8eade1e88 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.243613 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-17cf8c6a-5cfc-4f40-be51-a3c8eade1e88 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.244389 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-17cf8c6a-5cfc-4f40-be51-a3c8eade1e88 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.244826 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-17cf8c6a-5cfc-4f40-be51-a3c8eade1e88 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.320448 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-17cf8c6a-5cfc-4f40-be51-a3c8eade1e88 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:06.324043 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-63963a3f-e003-45d8-8c00-eed17436640b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:06.324734 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-63963a3f-e003-45d8-8c00-eed17436640b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:06.333664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-17cf8c6a-5cfc-4f40-be51-a3c8eade1e88 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1265 microversion: 2.1 time: 0.110722 May 27 09:40:06.334840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 97/179] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:06 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:06.338172 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-63963a3f-e003-45d8-8c00-eed17436640b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.340010 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-63963a3f-e003-45d8-8c00-eed17436640b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.340952 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-63963a3f-e003-45d8-8c00-eed17436640b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.341467 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-63963a3f-e003-45d8-8c00-eed17436640b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.581245 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-63963a3f-e003-45d8-8c00-eed17436640b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:06.590707 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-63963a3f-e003-45d8-8c00-eed17436640b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.271341 May 27 09:40:06.591984 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 83/180] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:06 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:06.784854 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-95537bde-f581-4e9f-9674-24d8179ea6f8 req-afe8d44d-e99d-4cda-a750-e70ea968520d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c817de-8115-43f6-9a05-6366318ea29f", "tag": "170fc0f5-d663-45e7-aca9-b414a735e887"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:06.796897 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-95537bde-f581-4e9f-9674-24d8179ea6f8 req-afe8d44d-e99d-4cda-a750-e70ea968520d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.802329 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-95537bde-f581-4e9f-9674-24d8179ea6f8 req-afe8d44d-e99d-4cda-a750-e70ea968520d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.829866 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-95537bde-f581-4e9f-9674-24d8179ea6f8 req-afe8d44d-e99d-4cda-a750-e70ea968520d service nova] Creating event network-changed:170fc0f5-d663-45e7-aca9-b414a735e887 for instance d5c817de-8115-43f6-9a05-6366318ea29f on hv-cinder-79760 May 27 09:40:06.844446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-95537bde-f581-4e9f-9674-24d8179ea6f8 req-afe8d44d-e99d-4cda-a750-e70ea968520d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061584 May 27 09:40:06.845250 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 98/181] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:06.853482 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6dac73d3-f58b-4d81-b75f-d1699dbb84bc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:06.854835 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6dac73d3-f58b-4d81-b75f-d1699dbb84bc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:06.882769 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dac73d3-f58b-4d81-b75f-d1699dbb84bc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.884770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dac73d3-f58b-4d81-b75f-d1699dbb84bc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.888332 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dac73d3-f58b-4d81-b75f-d1699dbb84bc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.892364 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dac73d3-f58b-4d81-b75f-d1699dbb84bc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.926475 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-6dac73d3-f58b-4d81-b75f-d1699dbb84bc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] HTTP exception thrown: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6dac73d3-f58b-4d81-b75f-d1699dbb84bc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Request method failure captured: May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 HTTP/1.1 May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJwrWZvUSbXc9c8RsLOOT7AxXR3gfxeQCR0rPbfClFSYb5I9cldASYFaBQU0n0br7dWn8j-FudJ6H7i9m_Nf99-gU6HBysMHzo4wFGtaxnpD7WYVAv9QpDqeV50_QRYbANVfcGqqDDnPa3c5vYixh164oRAvsaNXBy8oT_8hrgAFTwc May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 7479df6fb46a412398b2e1749b0cbd96 May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:40:06.940916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7479df6fb46a412398b2e1749b0cbd96"}]}] May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 7479df6fb46a412398b2e1749b0cbd96 May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-DeleteServersTestJSON-1899004207-project May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: f31b5e67d2ac4b80bf16a766a7f9f423 May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-DeleteServersTestJSON-1899004207-project May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:06.942291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '415b9b30-f34e-4800-a994-d0d7cb7344e5'} May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:40:06.942935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:06.944261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:06.945189 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6dac73d3-f58b-4d81-b75f-d1699dbb84bc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Returning 404 to user: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:40:06.947964 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6dac73d3-f58b-4d81-b75f-d1699dbb84bc tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 404 len: 111 microversion: 2.1 time: 0.102390 May 27 09:40:06.948998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 84/182] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:06 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 09:40:07.087690 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-20dd5ca1-3965-4368-86b2-9fc33cc48234 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:07.088891 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-20dd5ca1-3965-4368-86b2-9fc33cc48234 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:07.095712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20dd5ca1-3965-4368-86b2-9fc33cc48234 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:07.096157 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20dd5ca1-3965-4368-86b2-9fc33cc48234 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:07.096905 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20dd5ca1-3965-4368-86b2-9fc33cc48234 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:07.097384 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20dd5ca1-3965-4368-86b2-9fc33cc48234 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:07.110203 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-20dd5ca1-3965-4368-86b2-9fc33cc48234 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] HTTP exception thrown: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-20dd5ca1-3965-4368-86b2-9fc33cc48234 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Request method failure captured: May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5/os-volume_attachments HTTP/1.1 May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJwrWZvUSbXc9c8RsLOOT7AxXR3gfxeQCR0rPbfClFSYb5I9cldASYFaBQU0n0br7dWn8j-FudJ6H7i9m_Nf99-gU6HBysMHzo4wFGtaxnpD7WYVAv9QpDqeV50_QRYbANVfcGqqDDnPa3c5vYixh164oRAvsaNXBy8oT_8hrgAFTwc May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 7479df6fb46a412398b2e1749b0cbd96 May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:40:07.121101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7479df6fb46a412398b2e1749b0cbd96"}]}] May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 7479df6fb46a412398b2e1749b0cbd96 May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-DeleteServersTestJSON-1899004207-project May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: f31b5e67d2ac4b80bf16a766a7f9f423 May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-DeleteServersTestJSON-1899004207-project May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:07.122283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'server_id': '415b9b30-f34e-4800-a994-d0d7cb7344e5'} May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:40:07.123041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:07.124907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:40:07.126796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-20dd5ca1-3965-4368-86b2-9fc33cc48234 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Returning 404 to user: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:40:07.126796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-20dd5ca1-3965-4368-86b2-9fc33cc48234 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039573 May 27 09:40:07.126796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 99/183] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:40:07 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:40:07.356641 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-09af718c-93c8-478c-a509-94334763ce0b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:07.358006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-09af718c-93c8-478c-a509-94334763ce0b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:07.367179 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-09af718c-93c8-478c-a509-94334763ce0b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:07.368071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-09af718c-93c8-478c-a509-94334763ce0b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:07.369533 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-09af718c-93c8-478c-a509-94334763ce0b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:07.370187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-09af718c-93c8-478c-a509-94334763ce0b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:07.496077 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-09af718c-93c8-478c-a509-94334763ce0b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:07.512830 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-09af718c-93c8-478c-a509-94334763ce0b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1271 microversion: 2.1 time: 0.161901 May 27 09:40:07.514778 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 85/184] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:07 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:07.611026 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9f6d5cc3-49fc-4be6-af8b-20b01a50eebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:07.612344 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9f6d5cc3-49fc-4be6-af8b-20b01a50eebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:07.623980 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9f6d5cc3-49fc-4be6-af8b-20b01a50eebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:07.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9f6d5cc3-49fc-4be6-af8b-20b01a50eebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:07.626327 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9f6d5cc3-49fc-4be6-af8b-20b01a50eebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:07.628149 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9f6d5cc3-49fc-4be6-af8b-20b01a50eebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:07.970094 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9f6d5cc3-49fc-4be6-af8b-20b01a50eebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:07.990934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9f6d5cc3-49fc-4be6-af8b-20b01a50eebe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.385646 May 27 09:40:07.991660 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 100/185] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:07 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:08.531308 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-616bb52b-c541-4652-8a9b-adf23e77191a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:08.532110 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-616bb52b-c541-4652-8a9b-adf23e77191a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:08.538576 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-616bb52b-c541-4652-8a9b-adf23e77191a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:08.539159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-616bb52b-c541-4652-8a9b-adf23e77191a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:08.540015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-616bb52b-c541-4652-8a9b-adf23e77191a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:08.540516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-616bb52b-c541-4652-8a9b-adf23e77191a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:08.752910 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-616bb52b-c541-4652-8a9b-adf23e77191a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:08.760955 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-616bb52b-c541-4652-8a9b-adf23e77191a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1313 microversion: 2.1 time: 0.233398 May 27 09:40:08.762115 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 86/186] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:08 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:09.007483 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-069363b2-21ef-46cf-87c0-82c182243804 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:09.008701 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-069363b2-21ef-46cf-87c0-82c182243804 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:09.015396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-069363b2-21ef-46cf-87c0-82c182243804 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.016645 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-069363b2-21ef-46cf-87c0-82c182243804 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:09.017779 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-069363b2-21ef-46cf-87c0-82c182243804 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.018357 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-069363b2-21ef-46cf-87c0-82c182243804 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:09.280177 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-069363b2-21ef-46cf-87c0-82c182243804 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:09.291014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-069363b2-21ef-46cf-87c0-82c182243804 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.287242 May 27 09:40:09.302841 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 101/187] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:09 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:09.446213 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6bc479a9-9607-43fc-a3d0-f644cd8aabcb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:09.448632 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6bc479a9-9607-43fc-a3d0-f644cd8aabcb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:09.457318 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6bc479a9-9607-43fc-a3d0-f644cd8aabcb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.458218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6bc479a9-9607-43fc-a3d0-f644cd8aabcb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:09.459213 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6bc479a9-9607-43fc-a3d0-f644cd8aabcb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.459930 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6bc479a9-9607-43fc-a3d0-f644cd8aabcb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:09.482394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-ba3ff7ee-8bc6-48dd-a5b1-d7f247bb73a2 req-a9485056-bb0b-42ce-80e5-9d2bc93480dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a2ee7f6-4718-48ad-a7c9-0047319b9c15", "tag": "5932c00e-2b72-4238-a07a-4ad7909ecf5b"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:09.500070 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-ba3ff7ee-8bc6-48dd-a5b1-d7f247bb73a2 req-a9485056-bb0b-42ce-80e5-9d2bc93480dc service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.503855 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-6bc479a9-9607-43fc-a3d0-f644cd8aabcb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] HTTP exception thrown: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6bc479a9-9607-43fc-a3d0-f644cd8aabcb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Request method failure captured: May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 HTTP/1.1 May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJwrWZvUSbXc9c8RsLOOT7AxXR3gfxeQCR0rPbfClFSYb5I9cldASYFaBQU0n0br7dWn8j-FudJ6H7i9m_Nf99-gU6HBysMHzo4wFGtaxnpD7WYVAv9QpDqeV50_QRYbANVfcGqqDDnPa3c5vYixh164oRAvsaNXBy8oT_8hrgAFTwc May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 7479df6fb46a412398b2e1749b0cbd96 May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:40:09.506304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7479df6fb46a412398b2e1749b0cbd96"}]}] May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 7479df6fb46a412398b2e1749b0cbd96 May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-DeleteServersTestJSON-1899004207-project May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: f31b5e67d2ac4b80bf16a766a7f9f423 May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-DeleteServersTestJSON-1899004207-project May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:09.507732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '415b9b30-f34e-4800-a994-d0d7cb7344e5'} May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:40:09.508537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:09.509808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:09.511046 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6bc479a9-9607-43fc-a3d0-f644cd8aabcb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Returning 404 to user: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:40:09.515417 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-ba3ff7ee-8bc6-48dd-a5b1-d7f247bb73a2 req-a9485056-bb0b-42ce-80e5-9d2bc93480dc service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:09.520364 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6bc479a9-9607-43fc-a3d0-f644cd8aabcb tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "DELETE /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 404 len: 111 microversion: 2.1 time: 0.077879 May 27 09:40:09.522439 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 87/188] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:40:09 2022] DELETE /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:40:09.530866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f9404f26-6be5-4e1c-9372-9a3412868169 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:09.538616 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f9404f26-6be5-4e1c-9372-9a3412868169 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] [instance: 415b9b30-f34e-4800-a994-d0d7cb7344e5] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:09.543050 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-ba3ff7ee-8bc6-48dd-a5b1-d7f247bb73a2 req-a9485056-bb0b-42ce-80e5-9d2bc93480dc service nova] Creating event network-changed:5932c00e-2b72-4238-a07a-4ad7909ecf5b for instance 5a2ee7f6-4718-48ad-a7c9-0047319b9c15 on hv-cinder-79760 May 27 09:40:09.553617 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-ba3ff7ee-8bc6-48dd-a5b1-d7f247bb73a2 req-a9485056-bb0b-42ce-80e5-9d2bc93480dc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080262 May 27 09:40:09.553915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f9404f26-6be5-4e1c-9372-9a3412868169 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.554560 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f9404f26-6be5-4e1c-9372-9a3412868169 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:09.555561 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f9404f26-6be5-4e1c-9372-9a3412868169 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.556882 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f9404f26-6be5-4e1c-9372-9a3412868169 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:09.559966 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 102/189] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:09.572654 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-f9404f26-6be5-4e1c-9372-9a3412868169 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] HTTP exception thrown: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f9404f26-6be5-4e1c-9372-9a3412868169 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Request method failure captured: May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 HTTP/1.1 May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJwrWZvUSbXc9c8RsLOOT7AxXR3gfxeQCR0rPbfClFSYb5I9cldASYFaBQU0n0br7dWn8j-FudJ6H7i9m_Nf99-gU6HBysMHzo4wFGtaxnpD7WYVAv9QpDqeV50_QRYbANVfcGqqDDnPa3c5vYixh164oRAvsaNXBy8oT_8hrgAFTwc May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 7479df6fb46a412398b2e1749b0cbd96 May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:40:09.575225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/7479df6fb46a412398b2e1749b0cbd96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_7479df6fb46a412398b2e1749b0cbd96"}]}] May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 7479df6fb46a412398b2e1749b0cbd96 May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-DeleteServersTestJSON-1899004207 May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-DeleteServersTestJSON-1899004207-project May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: f31b5e67d2ac4b80bf16a766a7f9f423 May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-DeleteServersTestJSON-1899004207-project May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:09.576389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '415b9b30-f34e-4800-a994-d0d7cb7344e5'} May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:40:09.577036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. May 27 09:40:09.578059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:09.582374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f9404f26-6be5-4e1c-9372-9a3412868169 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] Returning 404 to user: Instance 415b9b30-f34e-4800-a994-d0d7cb7344e5 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:40:09.583468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f9404f26-6be5-4e1c-9372-9a3412868169 tempest-DeleteServersTestJSON-1899004207 tempest-DeleteServersTestJSON-1899004207-project] 10.222.0.41 "GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5" status: 404 len: 111 microversion: 2.1 time: 0.056442 May 27 09:40:09.587621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 88/190] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:09 2022] GET /compute/v2.1/servers/415b9b30-f34e-4800-a994-d0d7cb7344e5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:40:09.781265 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2aebad7c-61e3-45da-b536-5be0035fb48e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:09.782651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2aebad7c-61e3-45da-b536-5be0035fb48e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:09.789509 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2aebad7c-61e3-45da-b536-5be0035fb48e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.790322 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2aebad7c-61e3-45da-b536-5be0035fb48e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:09.791385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2aebad7c-61e3-45da-b536-5be0035fb48e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.792038 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2aebad7c-61e3-45da-b536-5be0035fb48e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:10.170362 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2aebad7c-61e3-45da-b536-5be0035fb48e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:10.181501 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2aebad7c-61e3-45da-b536-5be0035fb48e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1313 microversion: 2.1 time: 0.402743 May 27 09:40:10.182549 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 103/191] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:09 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:10.309389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8945388d-1656-40ff-a41b-7bf7926efc01 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:10.310020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8945388d-1656-40ff-a41b-7bf7926efc01 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:10.321581 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8945388d-1656-40ff-a41b-7bf7926efc01 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:10.322042 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8945388d-1656-40ff-a41b-7bf7926efc01 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:10.323011 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8945388d-1656-40ff-a41b-7bf7926efc01 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:10.327154 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8945388d-1656-40ff-a41b-7bf7926efc01 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:10.558945 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8945388d-1656-40ff-a41b-7bf7926efc01 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:10.582670 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8945388d-1656-40ff-a41b-7bf7926efc01 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.276548 May 27 09:40:10.595307 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 89/192] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:10 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:11.204689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-de496731-9775-472a-af0a-15eeef0144e8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:11.205454 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-de496731-9775-472a-af0a-15eeef0144e8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:11.211562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-de496731-9775-472a-af0a-15eeef0144e8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:11.212009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-de496731-9775-472a-af0a-15eeef0144e8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:11.212801 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-de496731-9775-472a-af0a-15eeef0144e8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:11.213267 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-de496731-9775-472a-af0a-15eeef0144e8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:11.345709 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-de496731-9775-472a-af0a-15eeef0144e8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:11.353511 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-de496731-9775-472a-af0a-15eeef0144e8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1313 microversion: 2.1 time: 0.154032 May 27 09:40:11.354080 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 104/193] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:11 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:11.600530 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1ff9cdf3-3dde-4ecf-9aa7-7e05cd19c87c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:11.601152 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1ff9cdf3-3dde-4ecf-9aa7-7e05cd19c87c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:11.607634 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1ff9cdf3-3dde-4ecf-9aa7-7e05cd19c87c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:11.608092 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1ff9cdf3-3dde-4ecf-9aa7-7e05cd19c87c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:11.608902 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1ff9cdf3-3dde-4ecf-9aa7-7e05cd19c87c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:11.609348 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1ff9cdf3-3dde-4ecf-9aa7-7e05cd19c87c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:11.766663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1ff9cdf3-3dde-4ecf-9aa7-7e05cd19c87c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:11.774346 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1ff9cdf3-3dde-4ecf-9aa7-7e05cd19c87c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.177955 May 27 09:40:11.774910 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 90/194] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:11 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:12.369681 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d1839a66-bc71-4ab0-9a7f-d1351f597cab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:12.370290 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d1839a66-bc71-4ab0-9a7f-d1351f597cab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:12.376953 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1839a66-bc71-4ab0-9a7f-d1351f597cab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:12.377515 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1839a66-bc71-4ab0-9a7f-d1351f597cab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:12.378728 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1839a66-bc71-4ab0-9a7f-d1351f597cab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:12.378843 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1839a66-bc71-4ab0-9a7f-d1351f597cab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:12.511786 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d1839a66-bc71-4ab0-9a7f-d1351f597cab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:12.519784 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d1839a66-bc71-4ab0-9a7f-d1351f597cab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1313 microversion: 2.1 time: 0.153925 May 27 09:40:12.520638 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 105/195] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:12 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:12.791570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d11c30ee-d2cd-49d2-955c-1548ab4bd098 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:12.792322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d11c30ee-d2cd-49d2-955c-1548ab4bd098 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:12.799961 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d11c30ee-d2cd-49d2-955c-1548ab4bd098 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:12.800411 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d11c30ee-d2cd-49d2-955c-1548ab4bd098 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:12.801202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d11c30ee-d2cd-49d2-955c-1548ab4bd098 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:12.801769 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d11c30ee-d2cd-49d2-955c-1548ab4bd098 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:12.934727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d11c30ee-d2cd-49d2-955c-1548ab4bd098 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:12.942836 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d11c30ee-d2cd-49d2-955c-1548ab4bd098 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.155031 May 27 09:40:12.952564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 91/196] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:12 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:13.128572 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-676565698", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "networks": [{"uuid": "04049278-c636-4fe8-a556-15302f4c13d9"}]}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:13.179768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] validate_networks() for [('04049278-c636-4fe8-a556-15302f4c13d9', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:40:13.536643 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-adfc7366-bcdd-4dc2-924d-ab69bc3f3d7a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:13.537249 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-adfc7366-bcdd-4dc2-924d-ab69bc3f3d7a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:13.543127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-adfc7366-bcdd-4dc2-924d-ab69bc3f3d7a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.543778 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-adfc7366-bcdd-4dc2-924d-ab69bc3f3d7a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.544923 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-adfc7366-bcdd-4dc2-924d-ab69bc3f3d7a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.545365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-adfc7366-bcdd-4dc2-924d-ab69bc3f3d7a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.549961 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=100 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:13.795650 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-adfc7366-bcdd-4dc2-924d-ab69bc3f3d7a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:13.804576 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-adfc7366-bcdd-4dc2-924d-ab69bc3f3d7a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1313 microversion: 2.1 time: 0.271661 May 27 09:40:13.805364 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 92/197] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:13 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:13.811551 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:40:13.812012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:40:13.812513 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:40:13.812961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:40:13.813377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:40:13.822631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.823078 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.823916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.824354 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.844940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Getting quotas for project fd5b7a3a6f5942b49b847f5d9ee9802a. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:40:13.849497 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Getting quotas for user 52e6eb075ba742e68bab4ab79eb37e1d and project fd5b7a3a6f5942b49b847f5d9ee9802a. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:40:13.860614 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:40:13.862894 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:40:13.918776 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3eecb7f5-d7f0-4059-8d65-8c1b8fd7fb86 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794018 May 27 09:40:13.919852 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 106/198] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:40:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:40:13.929406 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b9b8c483-2cbd-45c7-bef9-09f99c483ae7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:13.930012 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b9b8c483-2cbd-45c7-bef9-09f99c483ae7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:13.960543 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b76882c0-9d24-425e-9d5b-4761f34b37e4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:13.961159 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b76882c0-9d24-425e-9d5b-4761f34b37e4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:13.967877 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b76882c0-9d24-425e-9d5b-4761f34b37e4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.968532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b76882c0-9d24-425e-9d5b-4761f34b37e4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.969346 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b76882c0-9d24-425e-9d5b-4761f34b37e4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.970001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b76882c0-9d24-425e-9d5b-4761f34b37e4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.995645 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b9b8c483-2cbd-45c7-bef9-09f99c483ae7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:14.004287 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b9b8c483-2cbd-45c7-bef9-09f99c483ae7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1218 microversion: 2.1 time: 0.078522 May 27 09:40:14.015292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 93/199] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:13 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:14.159529 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b76882c0-9d24-425e-9d5b-4761f34b37e4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:14.168254 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b76882c0-9d24-425e-9d5b-4761f34b37e4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.211603 May 27 09:40:14.169124 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 107/200] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:13 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:14.822003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dae1568b-96dd-4f98-95a3-5a52096c91ba tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:14.822664 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dae1568b-96dd-4f98-95a3-5a52096c91ba tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:14.833610 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dae1568b-96dd-4f98-95a3-5a52096c91ba tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:14.834086 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dae1568b-96dd-4f98-95a3-5a52096c91ba tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:14.836711 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dae1568b-96dd-4f98-95a3-5a52096c91ba tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:14.837203 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dae1568b-96dd-4f98-95a3-5a52096c91ba tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:15.022575 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-14da989e-6535-435f-ab01-66da8556104d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:15.023220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-14da989e-6535-435f-ab01-66da8556104d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:15.035290 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-14da989e-6535-435f-ab01-66da8556104d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:15.037128 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-14da989e-6535-435f-ab01-66da8556104d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:15.037983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-14da989e-6535-435f-ab01-66da8556104d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:15.038421 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-14da989e-6535-435f-ab01-66da8556104d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:15.169652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dae1568b-96dd-4f98-95a3-5a52096c91ba tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:15.177692 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-14da989e-6535-435f-ab01-66da8556104d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:15.187696 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dae1568b-96dd-4f98-95a3-5a52096c91ba tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1313 microversion: 2.1 time: 0.369732 May 27 09:40:15.188307 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 94/201] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:14 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:15.193942 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0f4ac47a-d8d5-482a-8027-3ab37bf93199 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:15.195178 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0f4ac47a-d8d5-482a-8027-3ab37bf93199 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:15.204451 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-14da989e-6535-435f-ab01-66da8556104d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1214 microversion: 2.1 time: 0.184724 May 27 09:40:15.205567 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 108/202] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:15 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:15.211636 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f4ac47a-d8d5-482a-8027-3ab37bf93199 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:15.212104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f4ac47a-d8d5-482a-8027-3ab37bf93199 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:15.212888 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f4ac47a-d8d5-482a-8027-3ab37bf93199 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:15.213515 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f4ac47a-d8d5-482a-8027-3ab37bf93199 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:15.372323 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0f4ac47a-d8d5-482a-8027-3ab37bf93199 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:15.380484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0f4ac47a-d8d5-482a-8027-3ab37bf93199 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.190578 May 27 09:40:15.388119 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 95/203] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:15 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:16.205475 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ac07f99a-1cf8-4dce-9d6a-cb5dd4787b5d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:16.206121 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ac07f99a-1cf8-4dce-9d6a-cb5dd4787b5d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:16.215567 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac07f99a-1cf8-4dce-9d6a-cb5dd4787b5d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.224327 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-10b928f7-adad-45c3-8232-615753af1365 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:16.224944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-10b928f7-adad-45c3-8232-615753af1365 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:16.227659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac07f99a-1cf8-4dce-9d6a-cb5dd4787b5d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.228537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac07f99a-1cf8-4dce-9d6a-cb5dd4787b5d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.229002 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac07f99a-1cf8-4dce-9d6a-cb5dd4787b5d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.243785 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-10b928f7-adad-45c3-8232-615753af1365 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.244313 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-10b928f7-adad-45c3-8232-615753af1365 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.247670 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-10b928f7-adad-45c3-8232-615753af1365 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.248139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-10b928f7-adad-45c3-8232-615753af1365 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.404380 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-10b928f7-adad-45c3-8232-615753af1365 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:16.412489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-10b928f7-adad-45c3-8232-615753af1365 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1276 microversion: 2.1 time: 0.194465 May 27 09:40:16.415335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 96/204] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:16 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:16.418339 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0c4e4fcd-fb78-4b53-b255-ca62c348850e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:16.419445 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0c4e4fcd-fb78-4b53-b255-ca62c348850e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:16.425607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0c4e4fcd-fb78-4b53-b255-ca62c348850e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.426175 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0c4e4fcd-fb78-4b53-b255-ca62c348850e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.427188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0c4e4fcd-fb78-4b53-b255-ca62c348850e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.427770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0c4e4fcd-fb78-4b53-b255-ca62c348850e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.607550 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ac07f99a-1cf8-4dce-9d6a-cb5dd4787b5d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:16.628722 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ac07f99a-1cf8-4dce-9d6a-cb5dd4787b5d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1313 microversion: 2.1 time: 0.426457 May 27 09:40:16.636552 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 109/205] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:16 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:16.726458 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0c4e4fcd-fb78-4b53-b255-ca62c348850e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:16.737441 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0c4e4fcd-fb78-4b53-b255-ca62c348850e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.322744 May 27 09:40:16.738036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 97/206] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:16 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:17.430106 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-eaeeaeb5-6a43-45cc-869c-0b97a26acee7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:17.430852 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-eaeeaeb5-6a43-45cc-869c-0b97a26acee7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:17.445120 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eaeeaeb5-6a43-45cc-869c-0b97a26acee7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:17.445697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eaeeaeb5-6a43-45cc-869c-0b97a26acee7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:17.446775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eaeeaeb5-6a43-45cc-869c-0b97a26acee7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:17.449827 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eaeeaeb5-6a43-45cc-869c-0b97a26acee7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:17.453442 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-330d3c64-3176-4d0f-be8e-79812429e274 req-d4316005-7f9d-4dc7-b600-97ec8728c8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2ee7f6-4718-48ad-a7c9-0047319b9c15", "name": "network-vif-plugged", "status": "completed", "tag": "5932c00e-2b72-4238-a07a-4ad7909ecf5b"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:17.466332 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:17.477912 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-330d3c64-3176-4d0f-be8e-79812429e274 req-d4316005-7f9d-4dc7-b600-97ec8728c8e7 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:17.479115 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-330d3c64-3176-4d0f-be8e-79812429e274 req-d4316005-7f9d-4dc7-b600-97ec8728c8e7 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:17.512170 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-330d3c64-3176-4d0f-be8e-79812429e274 req-d4316005-7f9d-4dc7-b600-97ec8728c8e7 service nova] Creating event network-vif-plugged:5932c00e-2b72-4238-a07a-4ad7909ecf5b for instance 5a2ee7f6-4718-48ad-a7c9-0047319b9c15 on hv-cinder-79760 May 27 09:40:17.521061 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-330d3c64-3176-4d0f-be8e-79812429e274 req-d4316005-7f9d-4dc7-b600-97ec8728c8e7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072510 May 27 09:40:17.521675 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 98/207] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:17.648452 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-521db282-2dab-4fd5-8aea-e80dd648875b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:17.649145 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-521db282-2dab-4fd5-8aea-e80dd648875b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:17.658031 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-521db282-2dab-4fd5-8aea-e80dd648875b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:17.658499 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-521db282-2dab-4fd5-8aea-e80dd648875b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:17.659308 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-521db282-2dab-4fd5-8aea-e80dd648875b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:17.659736 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-521db282-2dab-4fd5-8aea-e80dd648875b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:17.941120 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-eaeeaeb5-6a43-45cc-869c-0b97a26acee7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:17.952330 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-eaeeaeb5-6a43-45cc-869c-0b97a26acee7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.524437 May 27 09:40:17.953679 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 110/208] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:17 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:17.966403 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4fe4cf20-87ac-4a3c-a5f1-85b803ecb6c1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:17.967030 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4fe4cf20-87ac-4a3c-a5f1-85b803ecb6c1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:17.982656 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4fe4cf20-87ac-4a3c-a5f1-85b803ecb6c1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:17.982924 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4fe4cf20-87ac-4a3c-a5f1-85b803ecb6c1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:17.985064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4fe4cf20-87ac-4a3c-a5f1-85b803ecb6c1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:17.985777 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4fe4cf20-87ac-4a3c-a5f1-85b803ecb6c1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:18.022141 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=100 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:18.076138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-521db282-2dab-4fd5-8aea-e80dd648875b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:18.088015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-521db282-2dab-4fd5-8aea-e80dd648875b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1313 microversion: 2.1 time: 0.443586 May 27 09:40:18.088848 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 99/209] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:17 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:18.233481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-5ccd9909-6d06-44b9-97e3-84e8b7320acc req-c5765ce8-d099-4476-b5fe-74e16561a305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410bf802-1682-4e5d-82ed-8a8603713349", "tag": "b7c050ec-eaef-48aa-bcb9-5a8f86f2595d"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:18.247297 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-5ccd9909-6d06-44b9-97e3-84e8b7320acc req-c5765ce8-d099-4476-b5fe-74e16561a305 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:18.248409 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-5ccd9909-6d06-44b9-97e3-84e8b7320acc req-c5765ce8-d099-4476-b5fe-74e16561a305 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:18.265425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4fe4cf20-87ac-4a3c-a5f1-85b803ecb6c1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:18.266644 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-5ccd9909-6d06-44b9-97e3-84e8b7320acc req-c5765ce8-d099-4476-b5fe-74e16561a305 service nova] Creating event network-changed:b7c050ec-eaef-48aa-bcb9-5a8f86f2595d for instance 410bf802-1682-4e5d-82ed-8a8603713349 on hv-cinder-79760 May 27 09:40:18.273026 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-5ccd9909-6d06-44b9-97e3-84e8b7320acc req-c5765ce8-d099-4476-b5fe-74e16561a305 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043839 May 27 09:40:18.274386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 100/210] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:40:18.278148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4fe4cf20-87ac-4a3c-a5f1-85b803ecb6c1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.320700 May 27 09:40:18.280058 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 111/211] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:17 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:18.970923 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7d8dd127-8342-484f-9f9d-9e8da139ff21 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:18.971762 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7d8dd127-8342-484f-9f9d-9e8da139ff21 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:18.978664 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7d8dd127-8342-484f-9f9d-9e8da139ff21 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:18.979336 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7d8dd127-8342-484f-9f9d-9e8da139ff21 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:18.980570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7d8dd127-8342-484f-9f9d-9e8da139ff21 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:18.981010 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7d8dd127-8342-484f-9f9d-9e8da139ff21 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.108735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-324c2916-6660-46cd-af08-e6550ebf2e2c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:19.110693 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-324c2916-6660-46cd-af08-e6550ebf2e2c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:19.119079 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-324c2916-6660-46cd-af08-e6550ebf2e2c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:19.119936 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-324c2916-6660-46cd-af08-e6550ebf2e2c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.123631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-324c2916-6660-46cd-af08-e6550ebf2e2c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:19.123631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-324c2916-6660-46cd-af08-e6550ebf2e2c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.149619 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7d8dd127-8342-484f-9f9d-9e8da139ff21 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:19.162146 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7d8dd127-8342-484f-9f9d-9e8da139ff21 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.195850 May 27 09:40:19.162736 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 101/212] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:18 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:19.297194 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-606453ca-43e6-4e88-a84f-b56d04bdf84c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:19.298220 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-606453ca-43e6-4e88-a84f-b56d04bdf84c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:19.307523 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-606453ca-43e6-4e88-a84f-b56d04bdf84c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:19.308392 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-606453ca-43e6-4e88-a84f-b56d04bdf84c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.309741 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-606453ca-43e6-4e88-a84f-b56d04bdf84c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:19.310472 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-606453ca-43e6-4e88-a84f-b56d04bdf84c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.621437 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-606453ca-43e6-4e88-a84f-b56d04bdf84c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:19.623847 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-324c2916-6660-46cd-af08-e6550ebf2e2c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:19.631198 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-324c2916-6660-46cd-af08-e6550ebf2e2c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1313 microversion: 2.1 time: 0.528312 May 27 09:40:19.631627 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-606453ca-43e6-4e88-a84f-b56d04bdf84c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.338504 May 27 09:40:19.639755 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 112/213] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:19 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:19.641655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 102/214] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:19 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:20.178116 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d5838f41-ab8a-4a65-b9a1-24a09e9bbb53 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:20.178723 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d5838f41-ab8a-4a65-b9a1-24a09e9bbb53 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:20.185241 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d5838f41-ab8a-4a65-b9a1-24a09e9bbb53 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.185241 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d5838f41-ab8a-4a65-b9a1-24a09e9bbb53 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:20.186020 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d5838f41-ab8a-4a65-b9a1-24a09e9bbb53 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.186528 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d5838f41-ab8a-4a65-b9a1-24a09e9bbb53 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:20.336035 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d5838f41-ab8a-4a65-b9a1-24a09e9bbb53 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:20.347976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d5838f41-ab8a-4a65-b9a1-24a09e9bbb53 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.173138 May 27 09:40:20.361219 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 113/215] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:20 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:20.650969 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cc7d90ff-1583-4e36-b07d-3d3bd2a8236d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:20.653395 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cc7d90ff-1583-4e36-b07d-3d3bd2a8236d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:20.658560 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-71670c38-3586-4cec-b9e9-41ed28154a3c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:20.659453 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-71670c38-3586-4cec-b9e9-41ed28154a3c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:20.660469 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cc7d90ff-1583-4e36-b07d-3d3bd2a8236d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.661244 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cc7d90ff-1583-4e36-b07d-3d3bd2a8236d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:20.662256 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cc7d90ff-1583-4e36-b07d-3d3bd2a8236d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.662916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cc7d90ff-1583-4e36-b07d-3d3bd2a8236d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:20.666369 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-71670c38-3586-4cec-b9e9-41ed28154a3c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.666819 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-71670c38-3586-4cec-b9e9-41ed28154a3c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:20.667846 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-71670c38-3586-4cec-b9e9-41ed28154a3c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.668282 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-71670c38-3586-4cec-b9e9-41ed28154a3c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:20.940980 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cc7d90ff-1583-4e36-b07d-3d3bd2a8236d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:20.948439 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cc7d90ff-1583-4e36-b07d-3d3bd2a8236d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1498 microversion: 2.1 time: 0.302408 May 27 09:40:20.949200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 103/216] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:20 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1498 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:20.979623 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-71670c38-3586-4cec-b9e9-41ed28154a3c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:20.987563 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-71670c38-3586-4cec-b9e9-41ed28154a3c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.333216 May 27 09:40:20.988609 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 114/217] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:20 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:21.368493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-bc061216-79a5-40c2-af0d-c3da7e4187e2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:21.369114 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bc061216-79a5-40c2-af0d-c3da7e4187e2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:21.375385 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bc061216-79a5-40c2-af0d-c3da7e4187e2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:21.375904 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bc061216-79a5-40c2-af0d-c3da7e4187e2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:21.376682 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bc061216-79a5-40c2-af0d-c3da7e4187e2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:21.377126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bc061216-79a5-40c2-af0d-c3da7e4187e2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:21.512006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bc061216-79a5-40c2-af0d-c3da7e4187e2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:21.519496 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-bc061216-79a5-40c2-af0d-c3da7e4187e2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.155105 May 27 09:40:21.520078 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 104/218] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:21 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:22.004709 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-93331a5a-3461-4b04-a2d9-3410459576fe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:22.005266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-93331a5a-3461-4b04-a2d9-3410459576fe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:22.011376 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-93331a5a-3461-4b04-a2d9-3410459576fe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.011828 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-93331a5a-3461-4b04-a2d9-3410459576fe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.012583 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-93331a5a-3461-4b04-a2d9-3410459576fe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.013018 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-93331a5a-3461-4b04-a2d9-3410459576fe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.138258 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-93331a5a-3461-4b04-a2d9-3410459576fe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:22.146303 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-93331a5a-3461-4b04-a2d9-3410459576fe tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.145566 May 27 09:40:22.146872 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 115/219] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:21 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:22.535430 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-920816a1-6478-499c-a43d-ae03388e2494 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:22.536036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-920816a1-6478-499c-a43d-ae03388e2494 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:22.542371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-920816a1-6478-499c-a43d-ae03388e2494 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.542817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-920816a1-6478-499c-a43d-ae03388e2494 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.543596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-920816a1-6478-499c-a43d-ae03388e2494 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.544029 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-920816a1-6478-499c-a43d-ae03388e2494 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.707604 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-920816a1-6478-499c-a43d-ae03388e2494 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:22.715992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-920816a1-6478-499c-a43d-ae03388e2494 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.184139 May 27 09:40:22.716785 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 105/220] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:22 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:22.972998 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fc226c5b-8beb-4dfc-b71a-a1132f7a9742 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:22.973678 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fc226c5b-8beb-4dfc-b71a-a1132f7a9742 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:22.979989 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc226c5b-8beb-4dfc-b71a-a1132f7a9742 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.980466 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc226c5b-8beb-4dfc-b71a-a1132f7a9742 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.981280 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc226c5b-8beb-4dfc-b71a-a1132f7a9742 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.981722 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc226c5b-8beb-4dfc-b71a-a1132f7a9742 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.008002 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fc226c5b-8beb-4dfc-b71a-a1132f7a9742 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Going to try to terminate instance {{(pid=129290) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:40:23.101028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fc226c5b-8beb-4dfc-b71a-a1132f7a9742 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 204 len: 0 microversion: 2.1 time: 0.133640 May 27 09:40:23.101934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 116/221] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:40:22 2022] DELETE /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 09:40:23.110289 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-37bd0b80-0e47-4335-8cf6-272e52426512 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:23.110902 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-37bd0b80-0e47-4335-8cf6-272e52426512 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:23.117829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-37bd0b80-0e47-4335-8cf6-272e52426512 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.118664 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-37bd0b80-0e47-4335-8cf6-272e52426512 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.119513 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-37bd0b80-0e47-4335-8cf6-272e52426512 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.120014 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-37bd0b80-0e47-4335-8cf6-272e52426512 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.164110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-86a7d98a-55be-4a96-bf2c-a3100045a65e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:23.164844 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-86a7d98a-55be-4a96-bf2c-a3100045a65e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:23.166835 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:23.172531 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-86a7d98a-55be-4a96-bf2c-a3100045a65e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.173245 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-86a7d98a-55be-4a96-bf2c-a3100045a65e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.174175 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-86a7d98a-55be-4a96-bf2c-a3100045a65e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.174762 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-86a7d98a-55be-4a96-bf2c-a3100045a65e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.309521 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-37bd0b80-0e47-4335-8cf6-272e52426512 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:23.317044 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-37bd0b80-0e47-4335-8cf6-272e52426512 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1504 microversion: 2.1 time: 0.211024 May 27 09:40:23.317626 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 106/222] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:23 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:23.330716 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-86a7d98a-55be-4a96-bf2c-a3100045a65e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:23.338187 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-86a7d98a-55be-4a96-bf2c-a3100045a65e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.178800 May 27 09:40:23.338751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 117/223] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:23 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:23.733011 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e59b8cbf-9b46-44c8-8e76-1281ce38bfea tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:23.733625 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e59b8cbf-9b46-44c8-8e76-1281ce38bfea tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:23.741525 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e59b8cbf-9b46-44c8-8e76-1281ce38bfea tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.741971 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e59b8cbf-9b46-44c8-8e76-1281ce38bfea tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.742737 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e59b8cbf-9b46-44c8-8e76-1281ce38bfea tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.743167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e59b8cbf-9b46-44c8-8e76-1281ce38bfea tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.877113 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e59b8cbf-9b46-44c8-8e76-1281ce38bfea tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:23.884951 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e59b8cbf-9b46-44c8-8e76-1281ce38bfea tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.155800 May 27 09:40:23.885529 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 107/224] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:23 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:24.334990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b0713777-ebb1-45ae-a158-f3aab89c30eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:24.335724 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b0713777-ebb1-45ae-a158-f3aab89c30eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:24.337452 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=4 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:24.338099 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=12 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:24.346149 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b0713777-ebb1-45ae-a158-f3aab89c30eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:24.346960 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b0713777-ebb1-45ae-a158-f3aab89c30eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:24.348553 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b0713777-ebb1-45ae-a158-f3aab89c30eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:24.349540 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b0713777-ebb1-45ae-a158-f3aab89c30eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:24.356912 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-68d75092-eacf-4143-a323-b22097baed71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:24.357519 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-68d75092-eacf-4143-a323-b22097baed71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:24.359549 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=4 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:24.369619 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-68d75092-eacf-4143-a323-b22097baed71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:24.370066 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-68d75092-eacf-4143-a323-b22097baed71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:24.370874 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-68d75092-eacf-4143-a323-b22097baed71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:24.371540 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-68d75092-eacf-4143-a323-b22097baed71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:24.573464 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b0713777-ebb1-45ae-a158-f3aab89c30eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:24.580478 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-68d75092-eacf-4143-a323-b22097baed71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:24.588088 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b0713777-ebb1-45ae-a158-f3aab89c30eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1504 microversion: 2.1 time: 0.257023 May 27 09:40:24.588676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 118/225] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:24 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:24.589002 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-68d75092-eacf-4143-a323-b22097baed71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.237265 May 27 09:40:24.589583 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 108/226] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:24 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:24.902483 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6ed7476a-b2fb-4847-9b9b-24c242a700cf tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:24.903185 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6ed7476a-b2fb-4847-9b9b-24c242a700cf tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:24.909953 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6ed7476a-b2fb-4847-9b9b-24c242a700cf tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:24.910801 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6ed7476a-b2fb-4847-9b9b-24c242a700cf tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:24.911611 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6ed7476a-b2fb-4847-9b9b-24c242a700cf tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:24.912046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6ed7476a-b2fb-4847-9b9b-24c242a700cf tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:25.048268 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6ed7476a-b2fb-4847-9b9b-24c242a700cf tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:25.055937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6ed7476a-b2fb-4847-9b9b-24c242a700cf tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.157994 May 27 09:40:25.056644 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 119/227] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:24 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:25.605990 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c864a973-dd88-43a2-9b23-e40f4f5fa38a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:25.606507 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-26873dfb-c62b-4dbb-bd01-56a6efab4889 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:25.606922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-26873dfb-c62b-4dbb-bd01-56a6efab4889 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:25.607014 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c864a973-dd88-43a2-9b23-e40f4f5fa38a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:25.612786 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-26873dfb-c62b-4dbb-bd01-56a6efab4889 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:25.613234 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-26873dfb-c62b-4dbb-bd01-56a6efab4889 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:25.613352 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c864a973-dd88-43a2-9b23-e40f4f5fa38a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:25.613696 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c864a973-dd88-43a2-9b23-e40f4f5fa38a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:25.614069 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-26873dfb-c62b-4dbb-bd01-56a6efab4889 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:25.614461 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c864a973-dd88-43a2-9b23-e40f4f5fa38a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:25.614632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-26873dfb-c62b-4dbb-bd01-56a6efab4889 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:25.614891 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c864a973-dd88-43a2-9b23-e40f4f5fa38a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:25.813571 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c864a973-dd88-43a2-9b23-e40f4f5fa38a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:25.821824 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-26873dfb-c62b-4dbb-bd01-56a6efab4889 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:25.823178 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c864a973-dd88-43a2-9b23-e40f4f5fa38a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1504 microversion: 2.1 time: 0.220634 May 27 09:40:25.825167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 109/228] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:25 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:25.832948 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-26873dfb-c62b-4dbb-bd01-56a6efab4889 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.230587 May 27 09:40:25.833948 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 120/229] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:25 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:26.073528 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-00a67626-ca10-465a-9053-f926a123d794 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:26.074225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-00a67626-ca10-465a-9053-f926a123d794 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:26.080704 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-00a67626-ca10-465a-9053-f926a123d794 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:26.081224 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-00a67626-ca10-465a-9053-f926a123d794 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:26.082058 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-00a67626-ca10-465a-9053-f926a123d794 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:26.082567 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-00a67626-ca10-465a-9053-f926a123d794 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:26.214086 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-00a67626-ca10-465a-9053-f926a123d794 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:26.221610 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-00a67626-ca10-465a-9053-f926a123d794 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.151875 May 27 09:40:26.222183 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 110/230] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:26 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:26.847155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1abbfcc9-c45a-4b45-987b-1692386ee21b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:26.848069 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1abbfcc9-c45a-4b45-987b-1692386ee21b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:26.853510 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6fed78b7-5325-47c5-a19a-3c208b3e63a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:26.854050 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1abbfcc9-c45a-4b45-987b-1692386ee21b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:26.854502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1abbfcc9-c45a-4b45-987b-1692386ee21b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:26.854989 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6fed78b7-5325-47c5-a19a-3c208b3e63a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:26.855363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1abbfcc9-c45a-4b45-987b-1692386ee21b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:26.855811 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1abbfcc9-c45a-4b45-987b-1692386ee21b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:26.864187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6fed78b7-5325-47c5-a19a-3c208b3e63a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:26.864729 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6fed78b7-5325-47c5-a19a-3c208b3e63a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:26.865528 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6fed78b7-5325-47c5-a19a-3c208b3e63a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:26.866054 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6fed78b7-5325-47c5-a19a-3c208b3e63a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:26.871099 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=100 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:27.069077 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1abbfcc9-c45a-4b45-987b-1692386ee21b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:27.071004 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6fed78b7-5325-47c5-a19a-3c208b3e63a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:27.078985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1abbfcc9-c45a-4b45-987b-1692386ee21b tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1504 microversion: 2.1 time: 0.234833 May 27 09:40:27.079375 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6fed78b7-5325-47c5-a19a-3c208b3e63a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.230883 May 27 09:40:27.079953 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 111/231] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:26 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:27.088959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 121/232] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:26 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:27.238495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1cc44e97-3eea-43ab-acd6-0dfedb2ed0d5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:27.239104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1cc44e97-3eea-43ab-acd6-0dfedb2ed0d5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:27.245304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1cc44e97-3eea-43ab-acd6-0dfedb2ed0d5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:27.245757 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1cc44e97-3eea-43ab-acd6-0dfedb2ed0d5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:27.246531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1cc44e97-3eea-43ab-acd6-0dfedb2ed0d5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:27.246975 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1cc44e97-3eea-43ab-acd6-0dfedb2ed0d5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:27.373635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1cc44e97-3eea-43ab-acd6-0dfedb2ed0d5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:27.381413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1cc44e97-3eea-43ab-acd6-0dfedb2ed0d5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.146767 May 27 09:40:27.381982 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 112/233] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:27 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:28.096726 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c86d66a3-d503-49db-b656-9c60769b012e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:28.097328 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8def0fe3-9de5-4289-bbf5-54b76a0fac22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:28.097328 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8def0fe3-9de5-4289-bbf5-54b76a0fac22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:28.098039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c86d66a3-d503-49db-b656-9c60769b012e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:28.104010 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c86d66a3-d503-49db-b656-9c60769b012e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:28.104252 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8def0fe3-9de5-4289-bbf5-54b76a0fac22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:28.104452 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c86d66a3-d503-49db-b656-9c60769b012e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:28.104705 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8def0fe3-9de5-4289-bbf5-54b76a0fac22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:28.105212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c86d66a3-d503-49db-b656-9c60769b012e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:28.105640 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c86d66a3-d503-49db-b656-9c60769b012e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:28.106846 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8def0fe3-9de5-4289-bbf5-54b76a0fac22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:28.107316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8def0fe3-9de5-4289-bbf5-54b76a0fac22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:28.299528 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8def0fe3-9de5-4289-bbf5-54b76a0fac22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:28.302570 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c86d66a3-d503-49db-b656-9c60769b012e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:28.307112 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8def0fe3-9de5-4289-bbf5-54b76a0fac22 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.214687 May 27 09:40:28.307793 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 113/234] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:28 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:28.310317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c86d66a3-d503-49db-b656-9c60769b012e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1504 microversion: 2.1 time: 0.217901 May 27 09:40:28.310884 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 122/235] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:28 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:28.398753 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d8bf450a-1463-4591-99f8-d6333b5c109d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:28.399397 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d8bf450a-1463-4591-99f8-d6333b5c109d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:28.405326 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8bf450a-1463-4591-99f8-d6333b5c109d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:28.405770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8bf450a-1463-4591-99f8-d6333b5c109d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:28.407033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8bf450a-1463-4591-99f8-d6333b5c109d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:28.407549 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8bf450a-1463-4591-99f8-d6333b5c109d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:28.529604 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d8bf450a-1463-4591-99f8-d6333b5c109d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:28.537777 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d8bf450a-1463-4591-99f8-d6333b5c109d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.142819 May 27 09:40:28.538343 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 114/236] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:28 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:29.324362 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-185606a4-ed3d-462b-8fa0-5568238c7948 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:29.325060 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-185606a4-ed3d-462b-8fa0-5568238c7948 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:29.326482 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-bd824b1b-c15e-4eef-a1df-3ee84b3b1c48 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:29.327167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bd824b1b-c15e-4eef-a1df-3ee84b3b1c48 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:29.336076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-185606a4-ed3d-462b-8fa0-5568238c7948 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:29.336076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-185606a4-ed3d-462b-8fa0-5568238c7948 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:29.336076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-185606a4-ed3d-462b-8fa0-5568238c7948 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:29.336076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-185606a4-ed3d-462b-8fa0-5568238c7948 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:29.336451 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bd824b1b-c15e-4eef-a1df-3ee84b3b1c48 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:29.336451 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bd824b1b-c15e-4eef-a1df-3ee84b3b1c48 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:29.336451 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bd824b1b-c15e-4eef-a1df-3ee84b3b1c48 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:29.336451 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bd824b1b-c15e-4eef-a1df-3ee84b3b1c48 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:29.550010 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-185606a4-ed3d-462b-8fa0-5568238c7948 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:29.557937 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bd824b1b-c15e-4eef-a1df-3ee84b3b1c48 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:29.564820 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-185606a4-ed3d-462b-8fa0-5568238c7948 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.244599 May 27 09:40:29.565446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 123/237] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:29 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:29.568684 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-bd824b1b-c15e-4eef-a1df-3ee84b3b1c48 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1504 microversion: 2.1 time: 0.245967 May 27 09:40:29.569510 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 115/238] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:29 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:29.570284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c5ca2e6f-71b3-4041-9e18-700cd79457c5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:29.570883 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c5ca2e6f-71b3-4041-9e18-700cd79457c5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:29.576773 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c5ca2e6f-71b3-4041-9e18-700cd79457c5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:29.577213 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c5ca2e6f-71b3-4041-9e18-700cd79457c5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:29.578018 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c5ca2e6f-71b3-4041-9e18-700cd79457c5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:29.578459 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c5ca2e6f-71b3-4041-9e18-700cd79457c5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:29.709112 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c5ca2e6f-71b3-4041-9e18-700cd79457c5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:29.723208 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c5ca2e6f-71b3-4041-9e18-700cd79457c5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.156314 May 27 09:40:29.724004 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 124/239] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:29 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:30.583577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ad4111fa-d6ea-4c89-acf0-b1620505f7be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:30.584188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ad4111fa-d6ea-4c89-acf0-b1620505f7be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:30.585013 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b8d4a600-afa8-4f3c-b5b6-8743a482b24e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:30.585772 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b8d4a600-afa8-4f3c-b5b6-8743a482b24e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:30.590912 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ad4111fa-d6ea-4c89-acf0-b1620505f7be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:30.591384 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ad4111fa-d6ea-4c89-acf0-b1620505f7be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:30.591546 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b8d4a600-afa8-4f3c-b5b6-8743a482b24e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:30.591980 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b8d4a600-afa8-4f3c-b5b6-8743a482b24e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:30.592155 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ad4111fa-d6ea-4c89-acf0-b1620505f7be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:30.592597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ad4111fa-d6ea-4c89-acf0-b1620505f7be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:30.592731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b8d4a600-afa8-4f3c-b5b6-8743a482b24e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:30.593163 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b8d4a600-afa8-4f3c-b5b6-8743a482b24e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:30.797108 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b8d4a600-afa8-4f3c-b5b6-8743a482b24e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:30.801927 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ad4111fa-d6ea-4c89-acf0-b1620505f7be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:30.805769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b8d4a600-afa8-4f3c-b5b6-8743a482b24e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1504 microversion: 2.1 time: 0.224453 May 27 09:40:30.806442 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 125/240] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:30 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:30.812609 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ad4111fa-d6ea-4c89-acf0-b1620505f7be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.231869 May 27 09:40:30.812609 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 116/241] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:30 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:30.816688 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-acbbab7b-5e9b-4fa3-886a-93dcc03b45ad tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:30.817350 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-acbbab7b-5e9b-4fa3-886a-93dcc03b45ad tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:30.823311 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-acbbab7b-5e9b-4fa3-886a-93dcc03b45ad tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:30.823765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-acbbab7b-5e9b-4fa3-886a-93dcc03b45ad tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:30.824541 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-acbbab7b-5e9b-4fa3-886a-93dcc03b45ad tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:30.824978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-acbbab7b-5e9b-4fa3-886a-93dcc03b45ad tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:30.943483 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-f062bb74-7832-4a0b-b33d-ff9ed1ace18e req-b6e9efb4-52aa-4b65-8f3e-7a5944191848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410bf802-1682-4e5d-82ed-8a8603713349", "name": "network-vif-plugged", "status": "completed", "tag": "b7c050ec-eaef-48aa-bcb9-5a8f86f2595d"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:30.953784 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-f062bb74-7832-4a0b-b33d-ff9ed1ace18e req-b6e9efb4-52aa-4b65-8f3e-7a5944191848 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:30.954340 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-f062bb74-7832-4a0b-b33d-ff9ed1ace18e req-b6e9efb4-52aa-4b65-8f3e-7a5944191848 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:30.960178 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-acbbab7b-5e9b-4fa3-886a-93dcc03b45ad tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:30.966934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-f062bb74-7832-4a0b-b33d-ff9ed1ace18e req-b6e9efb4-52aa-4b65-8f3e-7a5944191848 service nova] Creating event network-vif-plugged:b7c050ec-eaef-48aa-bcb9-5a8f86f2595d for instance 410bf802-1682-4e5d-82ed-8a8603713349 on hv-cinder-79760 May 27 09:40:30.968104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-acbbab7b-5e9b-4fa3-886a-93dcc03b45ad tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.154956 May 27 09:40:30.969317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 117/242] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:30 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:30.974440 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-f062bb74-7832-4a0b-b33d-ff9ed1ace18e req-b6e9efb4-52aa-4b65-8f3e-7a5944191848 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034984 May 27 09:40:30.975192 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 126/243] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:40:31.823177 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a8d8f23d-2c40-44a4-8fe7-80a7d8a8bda9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:31.824325 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a8d8f23d-2c40-44a4-8fe7-80a7d8a8bda9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:31.830582 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-dd3f4ffe-6e91-453a-ae25-06995456df2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:31.832178 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8d8f23d-2c40-44a4-8fe7-80a7d8a8bda9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:31.832387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-dd3f4ffe-6e91-453a-ae25-06995456df2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:31.832751 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8d8f23d-2c40-44a4-8fe7-80a7d8a8bda9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:31.833597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8d8f23d-2c40-44a4-8fe7-80a7d8a8bda9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:31.834230 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8d8f23d-2c40-44a4-8fe7-80a7d8a8bda9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:31.839444 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dd3f4ffe-6e91-453a-ae25-06995456df2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:31.840215 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dd3f4ffe-6e91-453a-ae25-06995456df2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:31.841008 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dd3f4ffe-6e91-453a-ae25-06995456df2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:31.841584 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dd3f4ffe-6e91-453a-ae25-06995456df2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:31.855582 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:32.098950 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-dd3f4ffe-6e91-453a-ae25-06995456df2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:32.103799 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a8d8f23d-2c40-44a4-8fe7-80a7d8a8bda9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:32.106538 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-dd3f4ffe-6e91-453a-ae25-06995456df2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.280582 May 27 09:40:32.112101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 127/244] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:31 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:32.123836 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a8d8f23d-2c40-44a4-8fe7-80a7d8a8bda9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1504 microversion: 2.1 time: 0.304649 May 27 09:40:32.133794 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 118/245] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:31 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:32.134301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-3bcded54-451b-4d7d-b38d-3afda323ba47 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:32.134301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3bcded54-451b-4d7d-b38d-3afda323ba47 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:32.134465 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3bcded54-451b-4d7d-b38d-3afda323ba47 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:32.134988 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3bcded54-451b-4d7d-b38d-3afda323ba47 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:32.135795 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3bcded54-451b-4d7d-b38d-3afda323ba47 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:32.136219 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3bcded54-451b-4d7d-b38d-3afda323ba47 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:32.278476 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-3bcded54-451b-4d7d-b38d-3afda323ba47 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:32.289942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3bcded54-451b-4d7d-b38d-3afda323ba47 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.176363 May 27 09:40:32.290799 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 128/246] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:32 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:33.123681 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9fdf7764-0584-46ac-b8f7-b4e0ede80493 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:33.124770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9fdf7764-0584-46ac-b8f7-b4e0ede80493 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:33.133564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fdf7764-0584-46ac-b8f7-b4e0ede80493 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:33.134053 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fdf7764-0584-46ac-b8f7-b4e0ede80493 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:33.140207 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fdf7764-0584-46ac-b8f7-b4e0ede80493 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:33.143856 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fdf7764-0584-46ac-b8f7-b4e0ede80493 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:33.161751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-79faf98b-13ce-4b19-8467-0f4bf9b80f55 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:33.164130 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-79faf98b-13ce-4b19-8467-0f4bf9b80f55 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:33.172419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-79faf98b-13ce-4b19-8467-0f4bf9b80f55 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:33.173559 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-79faf98b-13ce-4b19-8467-0f4bf9b80f55 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:33.174536 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-79faf98b-13ce-4b19-8467-0f4bf9b80f55 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:33.175501 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-79faf98b-13ce-4b19-8467-0f4bf9b80f55 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:33.622117 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-79faf98b-13ce-4b19-8467-0f4bf9b80f55 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:33.633157 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-79faf98b-13ce-4b19-8467-0f4bf9b80f55 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1504 microversion: 2.1 time: 0.493631 May 27 09:40:33.634654 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 129/247] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:33 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:33.646074 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-177b5b3a-a6de-4edc-a01b-72302c611b0a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:33.646684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-177b5b3a-a6de-4edc-a01b-72302c611b0a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:33.654416 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9fdf7764-0584-46ac-b8f7-b4e0ede80493 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:33.664479 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9fdf7764-0584-46ac-b8f7-b4e0ede80493 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.545713 May 27 09:40:33.679217 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 119/248] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:33 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:33.683606 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-177b5b3a-a6de-4edc-a01b-72302c611b0a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:33.685150 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-177b5b3a-a6de-4edc-a01b-72302c611b0a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:33.685951 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-177b5b3a-a6de-4edc-a01b-72302c611b0a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:33.688228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-177b5b3a-a6de-4edc-a01b-72302c611b0a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:33.850316 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-177b5b3a-a6de-4edc-a01b-72302c611b0a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:33.858164 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-177b5b3a-a6de-4edc-a01b-72302c611b0a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.222543 May 27 09:40:33.858946 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 130/249] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:33 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:34.652227 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2e30528e-65f8-4f9c-8ac9-4e54425e9834 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:34.652840 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2e30528e-65f8-4f9c-8ac9-4e54425e9834 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:34.660384 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2e30528e-65f8-4f9c-8ac9-4e54425e9834 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:34.660828 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2e30528e-65f8-4f9c-8ac9-4e54425e9834 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:34.661594 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2e30528e-65f8-4f9c-8ac9-4e54425e9834 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:34.662023 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2e30528e-65f8-4f9c-8ac9-4e54425e9834 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:34.685587 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ea6db467-bf3b-4d75-9fc5-51f811fb785c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:34.686194 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ea6db467-bf3b-4d75-9fc5-51f811fb785c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:34.697606 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ea6db467-bf3b-4d75-9fc5-51f811fb785c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:34.698233 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ea6db467-bf3b-4d75-9fc5-51f811fb785c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:34.701797 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ea6db467-bf3b-4d75-9fc5-51f811fb785c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:34.702289 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ea6db467-bf3b-4d75-9fc5-51f811fb785c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:34.895371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2e30528e-65f8-4f9c-8ac9-4e54425e9834 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:34.903982 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2e30528e-65f8-4f9c-8ac9-4e54425e9834 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1504 microversion: 2.1 time: 0.256104 May 27 09:40:34.904566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 120/250] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:34 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:34.910668 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-022a26b1-adc1-4d59-91e6-5d1a623a701b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:34.911289 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-022a26b1-adc1-4d59-91e6-5d1a623a701b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:34.918507 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-022a26b1-adc1-4d59-91e6-5d1a623a701b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:34.919882 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-022a26b1-adc1-4d59-91e6-5d1a623a701b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:34.920218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ea6db467-bf3b-4d75-9fc5-51f811fb785c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:34.920696 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-022a26b1-adc1-4d59-91e6-5d1a623a701b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:34.921117 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-022a26b1-adc1-4d59-91e6-5d1a623a701b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:34.930768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ea6db467-bf3b-4d75-9fc5-51f811fb785c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.248848 May 27 09:40:34.932501 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 131/251] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:34 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:35.093198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-022a26b1-adc1-4d59-91e6-5d1a623a701b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:35.104476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-022a26b1-adc1-4d59-91e6-5d1a623a701b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1318 microversion: 2.1 time: 0.196846 May 27 09:40:35.105933 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 121/252] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:34 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:35.930966 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0ef9bdbe-214b-41dc-9fc4-0a509b4e6398 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:35.931707 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0ef9bdbe-214b-41dc-9fc4-0a509b4e6398 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:35.938294 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ef9bdbe-214b-41dc-9fc4-0a509b4e6398 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:35.938817 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ef9bdbe-214b-41dc-9fc4-0a509b4e6398 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:35.939700 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ef9bdbe-214b-41dc-9fc4-0a509b4e6398 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:35.940195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ef9bdbe-214b-41dc-9fc4-0a509b4e6398 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:35.949614 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4e960d14-61b1-4c38-b996-a5ad1c67d92e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:35.950321 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4e960d14-61b1-4c38-b996-a5ad1c67d92e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:35.958482 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4e960d14-61b1-4c38-b996-a5ad1c67d92e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:35.959019 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4e960d14-61b1-4c38-b996-a5ad1c67d92e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:35.960136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4e960d14-61b1-4c38-b996-a5ad1c67d92e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:35.960681 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4e960d14-61b1-4c38-b996-a5ad1c67d92e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:36.022822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0ef9bdbe-214b-41dc-9fc4-0a509b4e6398 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:36.035103 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0ef9bdbe-214b-41dc-9fc4-0a509b4e6398 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1462 microversion: 2.1 time: 0.113617 May 27 09:40:36.036152 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 132/253] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:35 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1462 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:36.047378 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-daf9208c-856a-4ac8-aba8-5efe4e39e319 req-224a2b30-f09f-4aae-9627-df9fb73297d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a2ee7f6-4718-48ad-a7c9-0047319b9c15", "name": "network-vif-deleted", "tag": "5932c00e-2b72-4238-a07a-4ad7909ecf5b"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:36.057464 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-daf9208c-856a-4ac8-aba8-5efe4e39e319 req-224a2b30-f09f-4aae-9627-df9fb73297d0 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:36.057899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-daf9208c-856a-4ac8-aba8-5efe4e39e319 req-224a2b30-f09f-4aae-9627-df9fb73297d0 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:36.078255 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-daf9208c-856a-4ac8-aba8-5efe4e39e319 req-224a2b30-f09f-4aae-9627-df9fb73297d0 service nova] Creating event network-vif-deleted:5932c00e-2b72-4238-a07a-4ad7909ecf5b for instance 5a2ee7f6-4718-48ad-a7c9-0047319b9c15 on hv-cinder-79760 May 27 09:40:36.085868 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-daf9208c-856a-4ac8-aba8-5efe4e39e319 req-224a2b30-f09f-4aae-9627-df9fb73297d0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042916 May 27 09:40:36.086960 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 133/254] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:36.124066 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7a266601-3731-433e-88f8-c2a018adcb9a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:36.125383 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7a266601-3731-433e-88f8-c2a018adcb9a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:36.133780 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a266601-3731-433e-88f8-c2a018adcb9a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:36.134520 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a266601-3731-433e-88f8-c2a018adcb9a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:36.135637 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a266601-3731-433e-88f8-c2a018adcb9a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:36.136078 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a266601-3731-433e-88f8-c2a018adcb9a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:36.137175 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4e960d14-61b1-4c38-b996-a5ad1c67d92e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:36.146015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4e960d14-61b1-4c38-b996-a5ad1c67d92e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.201707 May 27 09:40:36.146809 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 122/255] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:35 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:36.313479 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7a266601-3731-433e-88f8-c2a018adcb9a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:36.323162 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7a266601-3731-433e-88f8-c2a018adcb9a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1506 microversion: 2.1 time: 0.203860 May 27 09:40:36.324665 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 134/256] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:36 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:37.055455 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:37.056183 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:37.063806 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:37.064444 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:37.065396 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:37.065990 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:37.101871 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:37.102475 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:37.103060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lazy-loading 'fault' on Instance uuid 5a2ee7f6-4718-48ad-a7c9-0047319b9c15 {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:40:37.149270 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:37.160691 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f59d2ac6-aa2e-472c-8c70-29227c638e9f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 200 len: 1303 microversion: 2.1 time: 0.109598 May 27 09:40:37.161289 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 123/257] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:37 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:37.163083 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e5d63520-7f3d-4278-bb88-389d6f5aaa83 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:37.163717 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e5d63520-7f3d-4278-bb88-389d6f5aaa83 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:37.176566 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5d63520-7f3d-4278-bb88-389d6f5aaa83 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:37.177018 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5d63520-7f3d-4278-bb88-389d6f5aaa83 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:37.177829 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5d63520-7f3d-4278-bb88-389d6f5aaa83 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:37.178545 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5d63520-7f3d-4278-bb88-389d6f5aaa83 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:37.328966 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e5d63520-7f3d-4278-bb88-389d6f5aaa83 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:37.337827 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e5d63520-7f3d-4278-bb88-389d6f5aaa83 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1521 microversion: 2.1 time: 0.178615 May 27 09:40:37.338496 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 135/258] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:37 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:38.179118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-753657b5-eed0-47b5-a91a-51f97cc9bbc4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:38.180456 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-753657b5-eed0-47b5-a91a-51f97cc9bbc4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 5a2ee7f6-4718-48ad-a7c9-0047319b9c15] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:38.187637 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-753657b5-eed0-47b5-a91a-51f97cc9bbc4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:38.188099 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-753657b5-eed0-47b5-a91a-51f97cc9bbc4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:38.189076 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-753657b5-eed0-47b5-a91a-51f97cc9bbc4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:38.189516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-753657b5-eed0-47b5-a91a-51f97cc9bbc4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:38.221560 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-753657b5-eed0-47b5-a91a-51f97cc9bbc4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] HTTP exception thrown: Instance 5a2ee7f6-4718-48ad-a7c9-0047319b9c15 could not be found. May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-753657b5-eed0-47b5-a91a-51f97cc9bbc4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Request method failure captured: May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 HTTP/1.1 May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJxwETt1bS8CxCt_r5fNw6KJFRpwoKu8Wr7l9dujKWS43ZHMsO5qBjP_vyldND_iIwtjddsMi1rCqd8QmkDnvB1jpie-L9CsvTTAPMvrL9dQynlFh_BIC64VSmRSqoGZGR9SmB_ZMKpnoX5JI1Kj3YcBYpKsJjp4OpLgbZyuSYpLYhU May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 4b17fac30e6a469a8e0ca8b6e2fcdc1d May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-VolumesActionsTest-2102171732 May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:40:38.223552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/4b17fac30e6a469a8e0ca8b6e2fcdc1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4b17fac30e6a469a8e0ca8b6e2fcdc1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4b17fac30e6a469a8e0ca8b6e2fcdc1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_4b17fac30e6a469a8e0ca8b6e2fcdc1d"}]}] May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-VolumesActionsTest-2102171732 May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 4b17fac30e6a469a8e0ca8b6e2fcdc1d May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-VolumesActionsTest-2102171732 May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-VolumesActionsTest-2102171732-project May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: b35535c6b1c74a0baf58c8ccdbf30772 May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-VolumesActionsTest-2102171732-project May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 5a2ee7f6-4718-48ad-a7c9-0047319b9c15 could not be found. May 27 09:40:38.224761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '5a2ee7f6-4718-48ad-a7c9-0047319b9c15'} May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a2ee7f6-4718-48ad-a7c9-0047319b9c15 could not be found. May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:40:38.225481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a2ee7f6-4718-48ad-a7c9-0047319b9c15 could not be found. May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a2ee7f6-4718-48ad-a7c9-0047319b9c15 could not be found. May 27 09:40:38.226596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:40:38.227636 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-753657b5-eed0-47b5-a91a-51f97cc9bbc4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Returning 404 to user: Instance 5a2ee7f6-4718-48ad-a7c9-0047319b9c15 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:40:38.232278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-753657b5-eed0-47b5-a91a-51f97cc9bbc4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15" status: 404 len: 111 microversion: 2.1 time: 0.050093 May 27 09:40:38.232985 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 124/259] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:38 2022] GET /compute/v2.1/servers/5a2ee7f6-4718-48ad-a7c9-0047319b9c15 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:40:38.363769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-dd4e7ea4-4293-4a23-afe2-a1fa53ea418b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:38.364381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-dd4e7ea4-4293-4a23-afe2-a1fa53ea418b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:38.384245 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dd4e7ea4-4293-4a23-afe2-a1fa53ea418b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:38.385062 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dd4e7ea4-4293-4a23-afe2-a1fa53ea418b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:38.385955 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dd4e7ea4-4293-4a23-afe2-a1fa53ea418b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:38.386502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dd4e7ea4-4293-4a23-afe2-a1fa53ea418b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:38.409541 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1503653432", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "networks": [{"uuid": "bc3314c2-6f7a-4cfb-97c0-f4db7429a577"}]}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:38.592228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-dd4e7ea4-4293-4a23-afe2-a1fa53ea418b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:38.601207 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-dd4e7ea4-4293-4a23-afe2-a1fa53ea418b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1501 microversion: 2.1 time: 0.249190 May 27 09:40:38.602228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 136/260] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:38 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:38.617777 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-195bcfe8-9c63-4bae-b2b3-02c2dc1f435b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:38.618385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-195bcfe8-9c63-4bae-b2b3-02c2dc1f435b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:38.624277 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-195bcfe8-9c63-4bae-b2b3-02c2dc1f435b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:38.625280 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-195bcfe8-9c63-4bae-b2b3-02c2dc1f435b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:38.626033 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-195bcfe8-9c63-4bae-b2b3-02c2dc1f435b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:38.626465 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-195bcfe8-9c63-4bae-b2b3-02c2dc1f435b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:38.794023 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-195bcfe8-9c63-4bae-b2b3-02c2dc1f435b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:38.803325 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-195bcfe8-9c63-4bae-b2b3-02c2dc1f435b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1516 microversion: 2.1 time: 0.189056 May 27 09:40:38.804139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 137/261] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:38 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:41.346903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0949e4a0-d681-422b-a033-9e5b9bae902c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:41.348958 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0949e4a0-d681-422b-a033-9e5b9bae902c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:41.355624 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0949e4a0-d681-422b-a033-9e5b9bae902c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:41.356357 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0949e4a0-d681-422b-a033-9e5b9bae902c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:41.357331 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0949e4a0-d681-422b-a033-9e5b9bae902c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:41.357949 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0949e4a0-d681-422b-a033-9e5b9bae902c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:41.381955 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-0949e4a0-d681-422b-a033-9e5b9bae902c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lazy-loading 'flavor' on Instance uuid abf3a64e-1d00-4751-816f-74abd2af6e39 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:40:41.466288 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0949e4a0-d681-422b-a033-9e5b9bae902c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39/action" status: 200 len: 32 microversion: 2.1 time: 0.124423 May 27 09:40:41.467111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 138/262] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:40:41 2022] POST /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:40:41.479085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4bbbb1d9-e7bf-4e57-b329-d5eea237907a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:41.479870 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4bbbb1d9-e7bf-4e57-b329-d5eea237907a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:41.486639 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4bbbb1d9-e7bf-4e57-b329-d5eea237907a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:41.487138 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4bbbb1d9-e7bf-4e57-b329-d5eea237907a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:41.488070 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4bbbb1d9-e7bf-4e57-b329-d5eea237907a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:41.488592 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4bbbb1d9-e7bf-4e57-b329-d5eea237907a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:41.944382 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4bbbb1d9-e7bf-4e57-b329-d5eea237907a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:41.953559 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4bbbb1d9-e7bf-4e57-b329-d5eea237907a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.479235 May 27 09:40:41.954431 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 139/263] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:41 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:42.971244 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c41ca14d-8aa7-48bb-9e33-778fe33d7de9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:42.971953 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c41ca14d-8aa7-48bb-9e33-778fe33d7de9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:42.978456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c41ca14d-8aa7-48bb-9e33-778fe33d7de9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:42.979110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c41ca14d-8aa7-48bb-9e33-778fe33d7de9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:42.980085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c41ca14d-8aa7-48bb-9e33-778fe33d7de9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:42.980682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c41ca14d-8aa7-48bb-9e33-778fe33d7de9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:43.472760 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c41ca14d-8aa7-48bb-9e33-778fe33d7de9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:43.485537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c41ca14d-8aa7-48bb-9e33-778fe33d7de9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.518289 May 27 09:40:43.486364 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 140/264] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:42 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:44.505212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6f21fc8d-1046-4d49-8cc6-51460dfaa3fb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:44.505927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6f21fc8d-1046-4d49-8cc6-51460dfaa3fb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:44.540427 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f21fc8d-1046-4d49-8cc6-51460dfaa3fb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:44.548752 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f21fc8d-1046-4d49-8cc6-51460dfaa3fb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:44.550041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f21fc8d-1046-4d49-8cc6-51460dfaa3fb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:44.550660 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f21fc8d-1046-4d49-8cc6-51460dfaa3fb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:44.775741 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6f21fc8d-1046-4d49-8cc6-51460dfaa3fb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:44.793377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6f21fc8d-1046-4d49-8cc6-51460dfaa3fb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.294826 May 27 09:40:44.803337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 141/265] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:44 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:45.810146 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8e6534db-75ea-4f03-8a1d-3376789e6bbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:45.810845 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8e6534db-75ea-4f03-8a1d-3376789e6bbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:45.817863 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8e6534db-75ea-4f03-8a1d-3376789e6bbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:45.818317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8e6534db-75ea-4f03-8a1d-3376789e6bbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:45.819107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8e6534db-75ea-4f03-8a1d-3376789e6bbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:45.819940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8e6534db-75ea-4f03-8a1d-3376789e6bbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:45.837699 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:45.977997 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8e6534db-75ea-4f03-8a1d-3376789e6bbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:45.986886 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8e6534db-75ea-4f03-8a1d-3376789e6bbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.180710 May 27 09:40:45.987976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 142/266] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:45 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:47.005143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1a917733-e751-4b3c-ba4b-8e754fe79b19 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:47.005755 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1a917733-e751-4b3c-ba4b-8e754fe79b19 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:47.025266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a917733-e751-4b3c-ba4b-8e754fe79b19 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:47.025722 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a917733-e751-4b3c-ba4b-8e754fe79b19 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:47.026520 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a917733-e751-4b3c-ba4b-8e754fe79b19 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:47.026953 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a917733-e751-4b3c-ba4b-8e754fe79b19 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:47.210239 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1a917733-e751-4b3c-ba4b-8e754fe79b19 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:47.220524 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1a917733-e751-4b3c-ba4b-8e754fe79b19 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.218990 May 27 09:40:47.221251 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 143/267] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:47 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:48.195229 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=81 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:48.244347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-38089b42-17c8-4a3f-b87a-02e8c74b04f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:48.247171 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-38089b42-17c8-4a3f-b87a-02e8c74b04f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:48.255123 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-38089b42-17c8-4a3f-b87a-02e8c74b04f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:48.256833 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-38089b42-17c8-4a3f-b87a-02e8c74b04f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:48.257884 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-38089b42-17c8-4a3f-b87a-02e8c74b04f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:48.258580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-38089b42-17c8-4a3f-b87a-02e8c74b04f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:48.430093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=57 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:48.627915 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-38089b42-17c8-4a3f-b87a-02e8c74b04f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:48.641126 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-38089b42-17c8-4a3f-b87a-02e8c74b04f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.406845 May 27 09:40:48.641660 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 144/268] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:48 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:49.660368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a4451dde-50e2-4c20-8e58-1272e15390ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:49.661066 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a4451dde-50e2-4c20-8e58-1272e15390ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:49.671675 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a4451dde-50e2-4c20-8e58-1272e15390ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:49.672044 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a4451dde-50e2-4c20-8e58-1272e15390ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:49.672828 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a4451dde-50e2-4c20-8e58-1272e15390ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:49.673267 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a4451dde-50e2-4c20-8e58-1272e15390ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:49.955917 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a4451dde-50e2-4c20-8e58-1272e15390ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:49.976139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a4451dde-50e2-4c20-8e58-1272e15390ee tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.314831 May 27 09:40:49.977738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 145/269] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:49 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:50.995491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5c7230d4-74dc-425b-aa64-f86b18ff7d7e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:50.996181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5c7230d4-74dc-425b-aa64-f86b18ff7d7e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:51.002829 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5c7230d4-74dc-425b-aa64-f86b18ff7d7e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:51.003303 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5c7230d4-74dc-425b-aa64-f86b18ff7d7e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:51.004152 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5c7230d4-74dc-425b-aa64-f86b18ff7d7e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:51.004624 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5c7230d4-74dc-425b-aa64-f86b18ff7d7e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:51.191066 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5c7230d4-74dc-425b-aa64-f86b18ff7d7e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:51.199151 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5c7230d4-74dc-425b-aa64-f86b18ff7d7e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.207618 May 27 09:40:51.200164 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 146/270] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:50 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:52.216287 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-beb0cb68-4db5-48a3-909f-22ca1fd6ac37 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:52.216947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-beb0cb68-4db5-48a3-909f-22ca1fd6ac37 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:52.223900 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-beb0cb68-4db5-48a3-909f-22ca1fd6ac37 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:52.224344 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-beb0cb68-4db5-48a3-909f-22ca1fd6ac37 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:52.225189 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-beb0cb68-4db5-48a3-909f-22ca1fd6ac37 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:52.225685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-beb0cb68-4db5-48a3-909f-22ca1fd6ac37 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:52.369922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-beb0cb68-4db5-48a3-909f-22ca1fd6ac37 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:52.377946 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-beb0cb68-4db5-48a3-909f-22ca1fd6ac37 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.165573 May 27 09:40:52.378514 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 147/271] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:52 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:53.394351 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a4c1f05a-5d75-47f3-a4ba-2d73bf06aff1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:53.395750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a4c1f05a-5d75-47f3-a4ba-2d73bf06aff1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:53.401878 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=62 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:53.405778 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a4c1f05a-5d75-47f3-a4ba-2d73bf06aff1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:53.407161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a4c1f05a-5d75-47f3-a4ba-2d73bf06aff1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:53.408878 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a4c1f05a-5d75-47f3-a4ba-2d73bf06aff1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:53.416631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a4c1f05a-5d75-47f3-a4ba-2d73bf06aff1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:53.597826 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a4c1f05a-5d75-47f3-a4ba-2d73bf06aff1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:53.608449 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a4c1f05a-5d75-47f3-a4ba-2d73bf06aff1 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.218050 May 27 09:40:53.619558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 148/272] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:53 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:54.239125 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.network.neutron [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] validate_networks() for [('bc3314c2-6f7a-4cfb-97c0-f4db7429a577', None, None, None, None, None)] {{(pid=129291) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:40:54.627922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a247e32f-f2b2-44b9-ab37-b2f7d1179c7a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:54.629914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a247e32f-f2b2-44b9-ab37-b2f7d1179c7a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:54.637152 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a247e32f-f2b2-44b9-ab37-b2f7d1179c7a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:54.637616 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a247e32f-f2b2-44b9-ab37-b2f7d1179c7a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:54.638883 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a247e32f-f2b2-44b9-ab37-b2f7d1179c7a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:54.640209 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a247e32f-f2b2-44b9-ab37-b2f7d1179c7a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:55.087654 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a247e32f-f2b2-44b9-ab37-b2f7d1179c7a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:55.089218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Flavor limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:40:55.090082 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Image limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:40:55.090701 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Flavor pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:40:55.091215 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Image pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:40:55.091932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:40:55.101315 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a247e32f-f2b2-44b9-ab37-b2f7d1179c7a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.479212 May 27 09:40:55.113489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:55.117487 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:55.118401 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:55.118931 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:55.120437 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 149/273] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:54 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:55.144921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Getting quotas for project 4b17fac30e6a469a8e0ca8b6e2fcdc1d. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:40:55.149319 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Getting quotas for user b35535c6b1c74a0baf58c8ccdbf30772 and project 4b17fac30e6a469a8e0ca8b6e2fcdc1d. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:40:55.164752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Going to run 1 instances... {{(pid=129291) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:40:55.180946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:40:55.241421 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-419c717e-5b33-4a6a-b348-2202bef77c21 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.836707 May 27 09:40:55.242783 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 125/274] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:40:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 16839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 09:40:55.252904 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e12a2ab5-f16b-4465-b14f-80d090795154 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:55.253525 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e12a2ab5-f16b-4465-b14f-80d090795154 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:55.335660 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e12a2ab5-f16b-4465-b14f-80d090795154 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:55.343571 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e12a2ab5-f16b-4465-b14f-80d090795154 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1214 microversion: 2.1 time: 0.094448 May 27 09:40:55.344992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 150/275] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:55 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:56.128547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5d8604fc-11dc-41db-a373-b782a69ba91b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:56.129273 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5d8604fc-11dc-41db-a373-b782a69ba91b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:56.143627 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5d8604fc-11dc-41db-a373-b782a69ba91b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:56.144396 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5d8604fc-11dc-41db-a373-b782a69ba91b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:56.145405 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5d8604fc-11dc-41db-a373-b782a69ba91b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:56.146042 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5d8604fc-11dc-41db-a373-b782a69ba91b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:56.374751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ab7d15cf-6596-4b41-945e-2cc8cb30dc00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:56.385893 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ab7d15cf-6596-4b41-945e-2cc8cb30dc00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:56.438908 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ab7d15cf-6596-4b41-945e-2cc8cb30dc00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:56.442750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ab7d15cf-6596-4b41-945e-2cc8cb30dc00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:56.443963 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ab7d15cf-6596-4b41-945e-2cc8cb30dc00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:56.444408 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ab7d15cf-6596-4b41-945e-2cc8cb30dc00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:56.459678 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5d8604fc-11dc-41db-a373-b782a69ba91b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:56.469718 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5d8604fc-11dc-41db-a373-b782a69ba91b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.344924 May 27 09:40:56.480299 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 126/276] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:56 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:56.556444 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ab7d15cf-6596-4b41-945e-2cc8cb30dc00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:56.573318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ab7d15cf-6596-4b41-945e-2cc8cb30dc00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1266 microversion: 2.1 time: 0.208645 May 27 09:40:56.575741 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 151/277] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:56 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:57.486858 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-62544e09-9082-45ba-a3d5-e08c9ebade81 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:57.488288 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-62544e09-9082-45ba-a3d5-e08c9ebade81 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:57.504396 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62544e09-9082-45ba-a3d5-e08c9ebade81 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:57.504857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62544e09-9082-45ba-a3d5-e08c9ebade81 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:57.505655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62544e09-9082-45ba-a3d5-e08c9ebade81 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:57.506093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62544e09-9082-45ba-a3d5-e08c9ebade81 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:57.594493 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d5bbebb4-aca5-4f9b-aee4-da90666de1fd tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:57.594493 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d5bbebb4-aca5-4f9b-aee4-da90666de1fd tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:57.613645 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d5bbebb4-aca5-4f9b-aee4-da90666de1fd tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:57.614324 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d5bbebb4-aca5-4f9b-aee4-da90666de1fd tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:57.615170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d5bbebb4-aca5-4f9b-aee4-da90666de1fd tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:57.615737 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d5bbebb4-aca5-4f9b-aee4-da90666de1fd tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:57.897226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-62544e09-9082-45ba-a3d5-e08c9ebade81 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:57.908226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-62544e09-9082-45ba-a3d5-e08c9ebade81 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.425166 May 27 09:40:57.908978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 127/278] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:57 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:57.933994 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d5bbebb4-aca5-4f9b-aee4-da90666de1fd tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:57.949372 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d5bbebb4-aca5-4f9b-aee4-da90666de1fd tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.360234 May 27 09:40:57.950219 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 152/279] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:57 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:58.580002 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-91e79f3e-5082-441f-bead-89286aace4c9 req-c8edef4b-388a-4d11-9279-5cb6ae47406d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d819828-35b1-4ba8-8309-4e66ec7ccf27", "tag": "29e0e6fe-fdf8-4aef-8d63-c82097856df5"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:58.596866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-91e79f3e-5082-441f-bead-89286aace4c9 req-c8edef4b-388a-4d11-9279-5cb6ae47406d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:58.598063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-91e79f3e-5082-441f-bead-89286aace4c9 req-c8edef4b-388a-4d11-9279-5cb6ae47406d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:58.619558 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-91e79f3e-5082-441f-bead-89286aace4c9 req-c8edef4b-388a-4d11-9279-5cb6ae47406d service nova] Creating event network-changed:29e0e6fe-fdf8-4aef-8d63-c82097856df5 for instance 8d819828-35b1-4ba8-8309-4e66ec7ccf27 on hv-cinder-79760 May 27 09:40:58.625116 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-91e79f3e-5082-441f-bead-89286aace4c9 req-c8edef4b-388a-4d11-9279-5cb6ae47406d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048357 May 27 09:40:58.625720 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 128/280] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:58.926518 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bdd10c26-ff2e-4f78-bc2b-1b6a2631deba tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:58.927964 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bdd10c26-ff2e-4f78-bc2b-1b6a2631deba tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:58.934520 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdd10c26-ff2e-4f78-bc2b-1b6a2631deba tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:58.938083 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdd10c26-ff2e-4f78-bc2b-1b6a2631deba tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:58.939170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdd10c26-ff2e-4f78-bc2b-1b6a2631deba tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:58.939927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdd10c26-ff2e-4f78-bc2b-1b6a2631deba tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:58.968105 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8be14225-3583-4dd8-bb7d-fb8fd9bc24b0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:58.969183 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8be14225-3583-4dd8-bb7d-fb8fd9bc24b0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:58.977699 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8be14225-3583-4dd8-bb7d-fb8fd9bc24b0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:58.978471 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8be14225-3583-4dd8-bb7d-fb8fd9bc24b0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:58.979370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8be14225-3583-4dd8-bb7d-fb8fd9bc24b0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:58.980025 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8be14225-3583-4dd8-bb7d-fb8fd9bc24b0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:59.262310 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bdd10c26-ff2e-4f78-bc2b-1b6a2631deba tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:59.272603 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bdd10c26-ff2e-4f78-bc2b-1b6a2631deba tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.350688 May 27 09:40:59.274405 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 153/281] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:58 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:59.278655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8be14225-3583-4dd8-bb7d-fb8fd9bc24b0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:59.289783 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8be14225-3583-4dd8-bb7d-fb8fd9bc24b0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.326360 May 27 09:40:59.290621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 129/282] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:40:58 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:00.289925 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d1861cb5-da32-44d1-a5fc-5aa24278954f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:00.291385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d1861cb5-da32-44d1-a5fc-5aa24278954f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:00.297590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1861cb5-da32-44d1-a5fc-5aa24278954f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:00.298278 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1861cb5-da32-44d1-a5fc-5aa24278954f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:00.299263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1861cb5-da32-44d1-a5fc-5aa24278954f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:00.299263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1861cb5-da32-44d1-a5fc-5aa24278954f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:00.305955 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e982231d-3c88-4c12-9b19-caad0d9ef0b5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:00.309006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e982231d-3c88-4c12-9b19-caad0d9ef0b5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:00.315891 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e982231d-3c88-4c12-9b19-caad0d9ef0b5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:00.316532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e982231d-3c88-4c12-9b19-caad0d9ef0b5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:00.317619 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e982231d-3c88-4c12-9b19-caad0d9ef0b5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:00.318204 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e982231d-3c88-4c12-9b19-caad0d9ef0b5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:00.526581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d1861cb5-da32-44d1-a5fc-5aa24278954f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:00.533239 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e982231d-3c88-4c12-9b19-caad0d9ef0b5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:00.534580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d1861cb5-da32-44d1-a5fc-5aa24278954f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.248471 May 27 09:41:00.535880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 154/283] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:00 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:00.542465 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e982231d-3c88-4c12-9b19-caad0d9ef0b5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.240366 May 27 09:41:00.552263 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 130/284] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:00 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:01.552220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-25ffe288-5200-4ae5-b500-b2e7054a703b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:01.553691 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-25ffe288-5200-4ae5-b500-b2e7054a703b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:01.560433 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-78933e55-f844-44a8-827e-35eb0853fee6 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:01.561118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-78933e55-f844-44a8-827e-35eb0853fee6 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:01.571984 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-25ffe288-5200-4ae5-b500-b2e7054a703b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:01.572418 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-25ffe288-5200-4ae5-b500-b2e7054a703b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:01.574800 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-78933e55-f844-44a8-827e-35eb0853fee6 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:01.575252 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-78933e55-f844-44a8-827e-35eb0853fee6 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:01.576250 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-25ffe288-5200-4ae5-b500-b2e7054a703b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:01.576791 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-25ffe288-5200-4ae5-b500-b2e7054a703b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:01.579630 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-78933e55-f844-44a8-827e-35eb0853fee6 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:01.580078 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-78933e55-f844-44a8-827e-35eb0853fee6 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:01.816250 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-25ffe288-5200-4ae5-b500-b2e7054a703b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:01.823774 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-78933e55-f844-44a8-827e-35eb0853fee6 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:01.826624 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-25ffe288-5200-4ae5-b500-b2e7054a703b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.278130 May 27 09:41:01.834525 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-78933e55-f844-44a8-827e-35eb0853fee6 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.278978 May 27 09:41:01.835761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 131/285] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:01 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:01.836991 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 155/286] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:01 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:02.852322 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ebb859e4-0024-4a71-94fa-882ac37b61d9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:02.853685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ebb859e4-0024-4a71-94fa-882ac37b61d9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:02.855587 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1bf9af21-9814-4aa7-bc55-77f3d12b5417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:02.856436 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1bf9af21-9814-4aa7-bc55-77f3d12b5417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:02.863878 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ebb859e4-0024-4a71-94fa-882ac37b61d9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:02.864608 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ebb859e4-0024-4a71-94fa-882ac37b61d9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:02.864732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1bf9af21-9814-4aa7-bc55-77f3d12b5417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:02.865065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1bf9af21-9814-4aa7-bc55-77f3d12b5417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:02.865954 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ebb859e4-0024-4a71-94fa-882ac37b61d9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:02.866071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1bf9af21-9814-4aa7-bc55-77f3d12b5417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:02.866564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1bf9af21-9814-4aa7-bc55-77f3d12b5417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:02.867051 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ebb859e4-0024-4a71-94fa-882ac37b61d9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:03.096126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1bf9af21-9814-4aa7-bc55-77f3d12b5417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:03.103107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ebb859e4-0024-4a71-94fa-882ac37b61d9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:03.105985 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1bf9af21-9814-4aa7-bc55-77f3d12b5417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.262840 May 27 09:41:03.115765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 132/287] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:02 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:03.116064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ebb859e4-0024-4a71-94fa-882ac37b61d9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.263134 May 27 09:41:03.116064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 156/288] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:02 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:04.122901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-64ec379f-7ba8-4d5e-937e-f75f218080db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:04.124244 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-64ec379f-7ba8-4d5e-937e-f75f218080db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:04.132861 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-64ec379f-7ba8-4d5e-937e-f75f218080db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:04.133276 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bf24ca33-29fa-4d96-8a87-adc0e4fc483c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:04.133783 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-64ec379f-7ba8-4d5e-937e-f75f218080db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:04.134324 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-64ec379f-7ba8-4d5e-937e-f75f218080db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:04.134423 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bf24ca33-29fa-4d96-8a87-adc0e4fc483c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:04.134855 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-64ec379f-7ba8-4d5e-937e-f75f218080db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:04.141356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bf24ca33-29fa-4d96-8a87-adc0e4fc483c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:04.142244 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bf24ca33-29fa-4d96-8a87-adc0e4fc483c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:04.143228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bf24ca33-29fa-4d96-8a87-adc0e4fc483c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:04.144487 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bf24ca33-29fa-4d96-8a87-adc0e4fc483c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:04.360569 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bf24ca33-29fa-4d96-8a87-adc0e4fc483c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:04.368788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bf24ca33-29fa-4d96-8a87-adc0e4fc483c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.239480 May 27 09:41:04.370068 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 157/289] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:04 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:04.389025 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-64ec379f-7ba8-4d5e-937e-f75f218080db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:04.396960 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-64ec379f-7ba8-4d5e-937e-f75f218080db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.278152 May 27 09:41:04.397646 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 133/290] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:04 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:04.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f058a818-5c47-4c50-affa-51edb673285a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Action: 'create', calling method: .version_select at 0x7f188c3dee50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1036635867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2cTqqjqj4bYIOlivhP5KxWKUi6zSh1kjQpq801nNYZePLNjtqv3OH88h8Up9QPpdB73oWornxFKKZzTwSSu4O10DPurPg1IQj/caugyFwfWvsWt2nR926gtjLIZud/3g=="}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:41:04.513316 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-f058a818-5c47-4c50-affa-51edb673285a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Getting quotas for project 050fc8655bd34646b1b3f211b6fd912a. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:41:04.517846 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-f058a818-5c47-4c50-affa-51edb673285a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Getting quotas for user 68b32d9217954d72a2b7aa3ba893f942 and project 050fc8655bd34646b1b3f211b6fd912a. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:41:04.539178 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f058a818-5c47-4c50-affa-51edb673285a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.042995 May 27 09:41:04.539805 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 158/291] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 09:41:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:41:04.586427 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2068823356", "imageRef": "5277c084-ad69-44a0-b62c-f8e942d9a3c4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1036635867", "networks": [{"uuid": "e39d3b32-496a-402d-8374-32120bd1e496"}]}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:41:04.634329 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.network.neutron [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] validate_networks() for [('e39d3b32-496a-402d-8374-32120bd1e496', None, None, None, None, None)] {{(pid=129291) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:41:04.997034 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Flavor limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:41:04.997467 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Image limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:41:04.997942 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Flavor pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:41:04.998353 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Image pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:41:04.999301 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:41:05.008678 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:05.009127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:05.009934 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:05.010374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:05.027817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Getting quotas for project 050fc8655bd34646b1b3f211b6fd912a. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:41:05.031703 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Getting quotas for user 68b32d9217954d72a2b7aa3ba893f942 and project 050fc8655bd34646b1b3f211b6fd912a. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:41:05.042954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Going to run 1 instances... {{(pid=129291) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:41:05.045190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5277c084-ad69-44a0-b62c-f8e942d9a3c4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:41:05.091199 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dbb8385c-d72a-41bf-b455-cd14438a8a8c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508562 May 27 09:41:05.091898 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 134/292] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:41:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:41:05.102037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-55fbd3f6-aaba-47ff-af79-069e3bae36c8 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:05.102769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-55fbd3f6-aaba-47ff-af79-069e3bae36c8 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:05.154826 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-55fbd3f6-aaba-47ff-af79-069e3bae36c8 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:05.161351 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-55fbd3f6-aaba-47ff-af79-069e3bae36c8 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1259 microversion: 2.1 time: 0.063261 May 27 09:41:05.161975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 159/293] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:05 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1259 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:05.386063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5984d745-41e1-4484-8798-7d006d6d0be0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:05.386802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5984d745-41e1-4484-8798-7d006d6d0be0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:05.393673 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5984d745-41e1-4484-8798-7d006d6d0be0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:05.394125 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5984d745-41e1-4484-8798-7d006d6d0be0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:05.394895 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5984d745-41e1-4484-8798-7d006d6d0be0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:05.395351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5984d745-41e1-4484-8798-7d006d6d0be0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:05.414427 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ecc5e98d-c5f3-4091-929a-abeca1589113 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:05.415043 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ecc5e98d-c5f3-4091-929a-abeca1589113 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:05.422283 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ecc5e98d-c5f3-4091-929a-abeca1589113 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:05.422739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ecc5e98d-c5f3-4091-929a-abeca1589113 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:05.423686 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ecc5e98d-c5f3-4091-929a-abeca1589113 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:05.424353 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ecc5e98d-c5f3-4091-929a-abeca1589113 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:05.793412 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5984d745-41e1-4484-8798-7d006d6d0be0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:05.801416 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5984d745-41e1-4484-8798-7d006d6d0be0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.419845 May 27 09:41:05.802193 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 135/294] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:05 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:05.804860 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ecc5e98d-c5f3-4091-929a-abeca1589113 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:05.812430 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ecc5e98d-c5f3-4091-929a-abeca1589113 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.401951 May 27 09:41:05.812988 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 160/295] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:05 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:06.177931 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ac08e44f-0160-416f-96ba-3a2773f2bf37 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:06.178539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ac08e44f-0160-416f-96ba-3a2773f2bf37 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:06.184433 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ac08e44f-0160-416f-96ba-3a2773f2bf37 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:06.184868 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ac08e44f-0160-416f-96ba-3a2773f2bf37 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:06.185620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ac08e44f-0160-416f-96ba-3a2773f2bf37 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:06.186059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ac08e44f-0160-416f-96ba-3a2773f2bf37 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:06.244425 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ac08e44f-0160-416f-96ba-3a2773f2bf37 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:06.251685 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ac08e44f-0160-416f-96ba-3a2773f2bf37 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1263 microversion: 2.1 time: 0.077606 May 27 09:41:06.252232 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 136/296] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:06 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1263 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:06.818285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-233aca71-7cd9-4897-a3d9-e4f4a80ca688 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:06.818889 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-233aca71-7cd9-4897-a3d9-e4f4a80ca688 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:06.824886 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-233aca71-7cd9-4897-a3d9-e4f4a80ca688 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:06.825331 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-233aca71-7cd9-4897-a3d9-e4f4a80ca688 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:06.826081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-233aca71-7cd9-4897-a3d9-e4f4a80ca688 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:06.826506 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-233aca71-7cd9-4897-a3d9-e4f4a80ca688 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:06.833463 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9c2f5026-1b07-4815-9b28-1a36b2d57ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:06.834238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9c2f5026-1b07-4815-9b28-1a36b2d57ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:06.843715 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c2f5026-1b07-4815-9b28-1a36b2d57ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:06.844168 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c2f5026-1b07-4815-9b28-1a36b2d57ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:06.844955 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c2f5026-1b07-4815-9b28-1a36b2d57ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:06.845394 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c2f5026-1b07-4815-9b28-1a36b2d57ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:07.029628 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-233aca71-7cd9-4897-a3d9-e4f4a80ca688 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:07.034415 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9c2f5026-1b07-4815-9b28-1a36b2d57ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:07.042196 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-233aca71-7cd9-4897-a3d9-e4f4a80ca688 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.227626 May 27 09:41:07.042988 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 161/297] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:06 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:07.044374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9c2f5026-1b07-4815-9b28-1a36b2d57ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.218470 May 27 09:41:07.044948 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 137/298] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:06 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:07.268228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7abd92e6-dd2b-4356-8921-cde345b83773 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:07.268834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7abd92e6-dd2b-4356-8921-cde345b83773 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:07.274853 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7abd92e6-dd2b-4356-8921-cde345b83773 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:07.275333 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7abd92e6-dd2b-4356-8921-cde345b83773 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:07.276093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7abd92e6-dd2b-4356-8921-cde345b83773 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:07.276523 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7abd92e6-dd2b-4356-8921-cde345b83773 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:07.278990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=100 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:07.335826 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7abd92e6-dd2b-4356-8921-cde345b83773 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:07.343794 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7abd92e6-dd2b-4356-8921-cde345b83773 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1263 microversion: 2.1 time: 0.079430 May 27 09:41:07.344361 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 162/299] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:07 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:08.059366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-562b5ebe-e106-487b-8fc8-4b0fe451a656 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:08.059995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-562b5ebe-e106-487b-8fc8-4b0fe451a656 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:08.062626 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2acc6fff-5f46-4175-99a0-78f2f14dbee7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:08.063715 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2acc6fff-5f46-4175-99a0-78f2f14dbee7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:08.066890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-562b5ebe-e106-487b-8fc8-4b0fe451a656 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:08.067379 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-562b5ebe-e106-487b-8fc8-4b0fe451a656 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:08.068156 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-562b5ebe-e106-487b-8fc8-4b0fe451a656 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:08.068594 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-562b5ebe-e106-487b-8fc8-4b0fe451a656 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:08.069208 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2acc6fff-5f46-4175-99a0-78f2f14dbee7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:08.069649 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2acc6fff-5f46-4175-99a0-78f2f14dbee7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:08.070548 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2acc6fff-5f46-4175-99a0-78f2f14dbee7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:08.070984 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2acc6fff-5f46-4175-99a0-78f2f14dbee7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:08.268398 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-562b5ebe-e106-487b-8fc8-4b0fe451a656 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:08.271323 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2acc6fff-5f46-4175-99a0-78f2f14dbee7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:08.275706 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-562b5ebe-e106-487b-8fc8-4b0fe451a656 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.220165 May 27 09:41:08.276278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 138/300] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:08 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:08.278785 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2acc6fff-5f46-4175-99a0-78f2f14dbee7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.221145 May 27 09:41:08.279371 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 163/301] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:08 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:08.360630 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ddd92b7a-496c-4141-9187-cf5e4d55d21a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:08.361157 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ddd92b7a-496c-4141-9187-cf5e4d55d21a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:08.367017 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ddd92b7a-496c-4141-9187-cf5e4d55d21a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:08.367513 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ddd92b7a-496c-4141-9187-cf5e4d55d21a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:08.368267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ddd92b7a-496c-4141-9187-cf5e4d55d21a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:08.368695 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ddd92b7a-496c-4141-9187-cf5e4d55d21a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:08.430957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ddd92b7a-496c-4141-9187-cf5e4d55d21a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:08.439222 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ddd92b7a-496c-4141-9187-cf5e4d55d21a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1263 microversion: 2.1 time: 0.082817 May 27 09:41:08.439817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 139/302] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:08 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:09.291799 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fc5a5226-ba6e-494f-8d26-5104a4459749 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:09.292449 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fc5a5226-ba6e-494f-8d26-5104a4459749 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:09.295794 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-14964b54-5e3e-4a7f-a3eb-77e9b4ce9645 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:09.296897 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-14964b54-5e3e-4a7f-a3eb-77e9b4ce9645 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:09.300009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc5a5226-ba6e-494f-8d26-5104a4459749 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:09.300464 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc5a5226-ba6e-494f-8d26-5104a4459749 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:09.301475 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc5a5226-ba6e-494f-8d26-5104a4459749 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:09.302054 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc5a5226-ba6e-494f-8d26-5104a4459749 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:09.303030 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-14964b54-5e3e-4a7f-a3eb-77e9b4ce9645 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:09.303589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-14964b54-5e3e-4a7f-a3eb-77e9b4ce9645 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:09.304372 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-14964b54-5e3e-4a7f-a3eb-77e9b4ce9645 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:09.304818 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-14964b54-5e3e-4a7f-a3eb-77e9b4ce9645 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:09.496410 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fc5a5226-ba6e-494f-8d26-5104a4459749 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:09.500681 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-14964b54-5e3e-4a7f-a3eb-77e9b4ce9645 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:09.506997 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fc5a5226-ba6e-494f-8d26-5104a4459749 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.219101 May 27 09:41:09.507745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 164/303] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:09 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:09.510416 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-14964b54-5e3e-4a7f-a3eb-77e9b4ce9645 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.218837 May 27 09:41:09.511147 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 140/304] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:09 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:09.512338 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7fadfb5a-3b20-464a-a09e-d0d3644be49e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:09.512974 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7fadfb5a-3b20-464a-a09e-d0d3644be49e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:09.518804 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7fadfb5a-3b20-464a-a09e-d0d3644be49e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:09.519245 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7fadfb5a-3b20-464a-a09e-d0d3644be49e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:09.520030 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7fadfb5a-3b20-464a-a09e-d0d3644be49e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:09.520460 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7fadfb5a-3b20-464a-a09e-d0d3644be49e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:09.582525 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7fadfb5a-3b20-464a-a09e-d0d3644be49e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:09.589860 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7fadfb5a-3b20-464a-a09e-d0d3644be49e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1263 microversion: 2.1 time: 0.081173 May 27 09:41:09.590417 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 165/305] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:09 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:10.525214 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-19c77c3e-9017-4550-b725-8fbc3e320bb8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:10.525880 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-19c77c3e-9017-4550-b725-8fbc3e320bb8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:10.527632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a7618e36-b76a-4af4-93cc-9ce9affe2ba2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:10.528260 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a7618e36-b76a-4af4-93cc-9ce9affe2ba2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:10.533118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-19c77c3e-9017-4550-b725-8fbc3e320bb8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:10.533578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-19c77c3e-9017-4550-b725-8fbc3e320bb8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:10.534432 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-19c77c3e-9017-4550-b725-8fbc3e320bb8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:10.534873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-19c77c3e-9017-4550-b725-8fbc3e320bb8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:10.540153 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a7618e36-b76a-4af4-93cc-9ce9affe2ba2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:10.540608 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a7618e36-b76a-4af4-93cc-9ce9affe2ba2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:10.541378 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a7618e36-b76a-4af4-93cc-9ce9affe2ba2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:10.541904 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a7618e36-b76a-4af4-93cc-9ce9affe2ba2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:10.725128 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-19c77c3e-9017-4550-b725-8fbc3e320bb8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:10.729303 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a7618e36-b76a-4af4-93cc-9ce9affe2ba2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:10.734922 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-19c77c3e-9017-4550-b725-8fbc3e320bb8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.213243 May 27 09:41:10.735963 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 141/306] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:10 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:10.741192 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fea0b8e5-46dd-4206-ae10-bafca01afc54 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:10.741744 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-fea0b8e5-46dd-4206-ae10-bafca01afc54 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:10.742126 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a7618e36-b76a-4af4-93cc-9ce9affe2ba2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.218745 May 27 09:41:10.742838 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 166/307] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:10 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:10.748049 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fea0b8e5-46dd-4206-ae10-bafca01afc54 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:10.749096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fea0b8e5-46dd-4206-ae10-bafca01afc54 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:10.749834 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fea0b8e5-46dd-4206-ae10-bafca01afc54 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:10.750278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fea0b8e5-46dd-4206-ae10-bafca01afc54 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:10.809298 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fea0b8e5-46dd-4206-ae10-bafca01afc54 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:10.817415 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fea0b8e5-46dd-4206-ae10-bafca01afc54 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1263 microversion: 2.1 time: 0.080207 May 27 09:41:10.818000 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 142/308] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:10 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:11.752489 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-982eaf55-3c1d-4958-93d3-85b2d3918930 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:11.753030 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-982eaf55-3c1d-4958-93d3-85b2d3918930 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:11.759384 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-982eaf55-3c1d-4958-93d3-85b2d3918930 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:11.759766 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-982eaf55-3c1d-4958-93d3-85b2d3918930 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:11.760538 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-982eaf55-3c1d-4958-93d3-85b2d3918930 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:11.760976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-982eaf55-3c1d-4958-93d3-85b2d3918930 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:11.763964 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-85ce54da-195c-4341-84d6-458a4880812f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:11.765784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-85ce54da-195c-4341-84d6-458a4880812f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:11.775313 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-85ce54da-195c-4341-84d6-458a4880812f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:11.776163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-85ce54da-195c-4341-84d6-458a4880812f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:11.778068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-85ce54da-195c-4341-84d6-458a4880812f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:11.779108 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-85ce54da-195c-4341-84d6-458a4880812f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:11.816054 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=100 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:11.960712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-982eaf55-3c1d-4958-93d3-85b2d3918930 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:11.968114 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-982eaf55-3c1d-4958-93d3-85b2d3918930 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.220141 May 27 09:41:11.968688 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 167/309] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:11 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:11.973290 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-07df911d-e687-482c-bebe-e399d489567e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:11.974094 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-07df911d-e687-482c-bebe-e399d489567e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:11.979713 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07df911d-e687-482c-bebe-e399d489567e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:11.980170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07df911d-e687-482c-bebe-e399d489567e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:11.980945 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07df911d-e687-482c-bebe-e399d489567e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:11.981376 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07df911d-e687-482c-bebe-e399d489567e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:11.983974 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-85ce54da-195c-4341-84d6-458a4880812f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:11.991349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-85ce54da-195c-4341-84d6-458a4880812f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.235610 May 27 09:41:11.992001 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 143/310] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:11 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:12.040942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-07df911d-e687-482c-bebe-e399d489567e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:12.049150 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-07df911d-e687-482c-bebe-e399d489567e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1263 microversion: 2.1 time: 0.079518 May 27 09:41:12.049750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 168/311] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:11 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:12.985195 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f4846024-19df-4cc5-b458-20cae0b98813 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:12.985800 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f4846024-19df-4cc5-b458-20cae0b98813 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:12.992355 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4846024-19df-4cc5-b458-20cae0b98813 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:12.992806 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4846024-19df-4cc5-b458-20cae0b98813 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:12.993571 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4846024-19df-4cc5-b458-20cae0b98813 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:12.994013 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4846024-19df-4cc5-b458-20cae0b98813 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:13.008525 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-3a4cf570-2f42-4871-a97b-4f8101101779 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:13.009134 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3a4cf570-2f42-4871-a97b-4f8101101779 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:13.015546 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3a4cf570-2f42-4871-a97b-4f8101101779 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:13.015987 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3a4cf570-2f42-4871-a97b-4f8101101779 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:13.016740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3a4cf570-2f42-4871-a97b-4f8101101779 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:13.017172 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3a4cf570-2f42-4871-a97b-4f8101101779 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:13.194183 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f4846024-19df-4cc5-b458-20cae0b98813 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:13.198266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-3a4cf570-2f42-4871-a97b-4f8101101779 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:13.202321 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f4846024-19df-4cc5-b458-20cae0b98813 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.220455 May 27 09:41:13.202890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 144/312] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:12 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:13.206254 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3a4cf570-2f42-4871-a97b-4f8101101779 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.201496 May 27 09:41:13.206825 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 169/313] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:13 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:13.215371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3faf2d2a-369f-4789-b867-5b9348a3bade tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:13.216011 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-3faf2d2a-369f-4789-b867-5b9348a3bade tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:13.222138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3faf2d2a-369f-4789-b867-5b9348a3bade tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:13.222585 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3faf2d2a-369f-4789-b867-5b9348a3bade tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:13.223376 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3faf2d2a-369f-4789-b867-5b9348a3bade tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:13.223819 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3faf2d2a-369f-4789-b867-5b9348a3bade tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:13.284694 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-3faf2d2a-369f-4789-b867-5b9348a3bade tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:13.291896 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3faf2d2a-369f-4789-b867-5b9348a3bade tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1263 microversion: 2.1 time: 0.080233 May 27 09:41:13.292465 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 145/314] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:13 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:14.220469 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-96788f2d-21e4-4c93-9e69-4356783f2a32 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:14.221050 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-96788f2d-21e4-4c93-9e69-4356783f2a32 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:14.224417 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9e431377-0199-47b6-b6bc-6aaa898600a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:14.225565 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9e431377-0199-47b6-b6bc-6aaa898600a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:14.227606 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-96788f2d-21e4-4c93-9e69-4356783f2a32 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:14.228058 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-96788f2d-21e4-4c93-9e69-4356783f2a32 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:14.228820 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-96788f2d-21e4-4c93-9e69-4356783f2a32 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:14.229478 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-96788f2d-21e4-4c93-9e69-4356783f2a32 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:14.233637 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9e431377-0199-47b6-b6bc-6aaa898600a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:14.234409 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9e431377-0199-47b6-b6bc-6aaa898600a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:14.235472 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9e431377-0199-47b6-b6bc-6aaa898600a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:14.235921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9e431377-0199-47b6-b6bc-6aaa898600a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:14.489556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9e431377-0199-47b6-b6bc-6aaa898600a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:14.497213 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9e431377-0199-47b6-b6bc-6aaa898600a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.277563 May 27 09:41:14.497556 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-96788f2d-21e4-4c93-9e69-4356783f2a32 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:14.497799 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 146/315] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:14 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:14.502258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-01ef9074-bfd0-4e3e-9c5a-156ab760b6c9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:14.502859 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-01ef9074-bfd0-4e3e-9c5a-156ab760b6c9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:14.505391 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-96788f2d-21e4-4c93-9e69-4356783f2a32 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.289484 May 27 09:41:14.510422 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-01ef9074-bfd0-4e3e-9c5a-156ab760b6c9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:14.510970 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-01ef9074-bfd0-4e3e-9c5a-156ab760b6c9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:14.511893 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-01ef9074-bfd0-4e3e-9c5a-156ab760b6c9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:14.512353 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-01ef9074-bfd0-4e3e-9c5a-156ab760b6c9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:14.517076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 170/316] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:14 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:14.573850 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-01ef9074-bfd0-4e3e-9c5a-156ab760b6c9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:14.583487 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-01ef9074-bfd0-4e3e-9c5a-156ab760b6c9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1311 microversion: 2.1 time: 0.084648 May 27 09:41:14.584188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 147/317] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:14 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:15.515436 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-3e4b376a-9ebc-447e-9ad9-e45d85c69a4c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:15.517145 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3e4b376a-9ebc-447e-9ad9-e45d85c69a4c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:15.523021 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=8 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:15.525731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3e4b376a-9ebc-447e-9ad9-e45d85c69a4c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:15.526254 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-965b5c97-5b8c-4662-aa7b-e481a984656e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:15.527471 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3e4b376a-9ebc-447e-9ad9-e45d85c69a4c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:15.527750 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-965b5c97-5b8c-4662-aa7b-e481a984656e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:15.529049 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3e4b376a-9ebc-447e-9ad9-e45d85c69a4c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:15.529975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3e4b376a-9ebc-447e-9ad9-e45d85c69a4c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:15.534417 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=4 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:15.535074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=12 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:15.538107 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-965b5c97-5b8c-4662-aa7b-e481a984656e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:15.539640 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-965b5c97-5b8c-4662-aa7b-e481a984656e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:15.540991 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-965b5c97-5b8c-4662-aa7b-e481a984656e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:15.542451 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-965b5c97-5b8c-4662-aa7b-e481a984656e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:15.854701 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-3e4b376a-9ebc-447e-9ad9-e45d85c69a4c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:15.864090 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3e4b376a-9ebc-447e-9ad9-e45d85c69a4c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.353509 May 27 09:41:15.864581 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-965b5c97-5b8c-4662-aa7b-e481a984656e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:15.865139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 171/318] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:15 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:15.874266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-965b5c97-5b8c-4662-aa7b-e481a984656e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.353333 May 27 09:41:15.874849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 148/319] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:15 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:15.885217 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-72e9f26f-54fe-452f-93ad-25fefd0d558f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:15.886059 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-72e9f26f-54fe-452f-93ad-25fefd0d558f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:15.894191 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72e9f26f-54fe-452f-93ad-25fefd0d558f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:15.894858 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72e9f26f-54fe-452f-93ad-25fefd0d558f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:15.895868 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72e9f26f-54fe-452f-93ad-25fefd0d558f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:15.896454 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72e9f26f-54fe-452f-93ad-25fefd0d558f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:16.197913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-72e9f26f-54fe-452f-93ad-25fefd0d558f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:16.208265 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-72e9f26f-54fe-452f-93ad-25fefd0d558f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.341558 May 27 09:41:16.208691 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 172/320] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:15 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:16.880995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-eee67445-3997-4f3e-ab26-08bf590b4bd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:16.881731 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-eee67445-3997-4f3e-ab26-08bf590b4bd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:16.888497 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eee67445-3997-4f3e-ab26-08bf590b4bd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:16.889530 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eee67445-3997-4f3e-ab26-08bf590b4bd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:16.890288 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eee67445-3997-4f3e-ab26-08bf590b4bd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:16.890733 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eee67445-3997-4f3e-ab26-08bf590b4bd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:16.893064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-36c0da0b-d3fe-4620-9a65-7da20d79678d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:16.894197 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-36c0da0b-d3fe-4620-9a65-7da20d79678d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:16.901156 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-36c0da0b-d3fe-4620-9a65-7da20d79678d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:16.901573 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-36c0da0b-d3fe-4620-9a65-7da20d79678d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:16.902346 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-36c0da0b-d3fe-4620-9a65-7da20d79678d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:16.902774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-36c0da0b-d3fe-4620-9a65-7da20d79678d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:17.386980 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-eee67445-3997-4f3e-ab26-08bf590b4bd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:17.389773 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-36c0da0b-d3fe-4620-9a65-7da20d79678d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:17.398868 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-eee67445-3997-4f3e-ab26-08bf590b4bd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.521576 May 27 09:41:17.399921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 149/321] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:16 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:17.405179 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-eb7af1df-fb88-4563-96f5-1fef9f2b7429 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:17.405974 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-eb7af1df-fb88-4563-96f5-1fef9f2b7429 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:17.413184 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eb7af1df-fb88-4563-96f5-1fef9f2b7429 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:17.414076 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eb7af1df-fb88-4563-96f5-1fef9f2b7429 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:17.415323 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eb7af1df-fb88-4563-96f5-1fef9f2b7429 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:17.415927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-36c0da0b-d3fe-4620-9a65-7da20d79678d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.525463 May 27 09:41:17.416330 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eb7af1df-fb88-4563-96f5-1fef9f2b7429 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:17.417005 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 173/322] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:16 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:17.589901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-eb7af1df-fb88-4563-96f5-1fef9f2b7429 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:17.604007 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-eb7af1df-fb88-4563-96f5-1fef9f2b7429 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.202731 May 27 09:41:17.614384 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 150/323] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:17 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:17.696862 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-e35f03ea-74a5-4a68-9e92-317135d8f2ee req-bed6d8d3-2b89-455d-981c-8a542de6a7db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d819828-35b1-4ba8-8309-4e66ec7ccf27", "name": "network-vif-plugged", "status": "completed", "tag": "29e0e6fe-fdf8-4aef-8d63-c82097856df5"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:41:17.706559 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e35f03ea-74a5-4a68-9e92-317135d8f2ee req-bed6d8d3-2b89-455d-981c-8a542de6a7db service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:17.707010 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e35f03ea-74a5-4a68-9e92-317135d8f2ee req-bed6d8d3-2b89-455d-981c-8a542de6a7db service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:17.720461 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-e35f03ea-74a5-4a68-9e92-317135d8f2ee req-bed6d8d3-2b89-455d-981c-8a542de6a7db service nova] Creating event network-vif-plugged:29e0e6fe-fdf8-4aef-8d63-c82097856df5 for instance 8d819828-35b1-4ba8-8309-4e66ec7ccf27 on hv-cinder-79760 May 27 09:41:17.725712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-e35f03ea-74a5-4a68-9e92-317135d8f2ee req-bed6d8d3-2b89-455d-981c-8a542de6a7db service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032592 May 27 09:41:17.726306 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 174/324] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:41:18.415511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5f7ed48e-ec12-4089-98e4-c10d62684312 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:18.416121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5f7ed48e-ec12-4089-98e4-c10d62684312 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:18.423016 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5f7ed48e-ec12-4089-98e4-c10d62684312 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:18.423491 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5f7ed48e-ec12-4089-98e4-c10d62684312 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:18.424253 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5f7ed48e-ec12-4089-98e4-c10d62684312 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:18.424686 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5f7ed48e-ec12-4089-98e4-c10d62684312 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:18.433434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-da9e797d-2a25-47ae-b94d-398e27a28ab9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:18.434130 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-da9e797d-2a25-47ae-b94d-398e27a28ab9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:18.440395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da9e797d-2a25-47ae-b94d-398e27a28ab9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:18.440839 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da9e797d-2a25-47ae-b94d-398e27a28ab9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:18.441596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da9e797d-2a25-47ae-b94d-398e27a28ab9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:18.442033 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da9e797d-2a25-47ae-b94d-398e27a28ab9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:18.633587 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5f7ed48e-ec12-4089-98e4-c10d62684312 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:18.643532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5f7ed48e-ec12-4089-98e4-c10d62684312 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.231428 May 27 09:41:18.653983 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 151/325] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:18 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:18.654223 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-da9e797d-2a25-47ae-b94d-398e27a28ab9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:18.656324 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-da9e797d-2a25-47ae-b94d-398e27a28ab9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.226941 May 27 09:41:18.656943 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 175/326] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:18 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:18.660037 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a3d41ea6-c3b4-48ff-b64c-8ea4bf8bc900 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:18.660822 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a3d41ea6-c3b4-48ff-b64c-8ea4bf8bc900 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:18.677891 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:18.684621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3d41ea6-c3b4-48ff-b64c-8ea4bf8bc900 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:18.685162 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3d41ea6-c3b4-48ff-b64c-8ea4bf8bc900 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:18.686158 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3d41ea6-c3b4-48ff-b64c-8ea4bf8bc900 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:18.686608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3d41ea6-c3b4-48ff-b64c-8ea4bf8bc900 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:18.819013 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a3d41ea6-c3b4-48ff-b64c-8ea4bf8bc900 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:18.827117 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a3d41ea6-c3b4-48ff-b64c-8ea4bf8bc900 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.170280 May 27 09:41:18.827804 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 152/327] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:18 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:19.661990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-54e63b88-350e-401e-a2c9-830fefb5b4be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:19.662591 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-54e63b88-350e-401e-a2c9-830fefb5b4be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:19.669552 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54e63b88-350e-401e-a2c9-830fefb5b4be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:19.670822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54e63b88-350e-401e-a2c9-830fefb5b4be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:19.671988 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54e63b88-350e-401e-a2c9-830fefb5b4be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:19.672553 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54e63b88-350e-401e-a2c9-830fefb5b4be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:19.676659 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a27ea3e3-7d71-4f20-9d7a-4701f4bb6a00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:19.677936 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a27ea3e3-7d71-4f20-9d7a-4701f4bb6a00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:19.684993 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a27ea3e3-7d71-4f20-9d7a-4701f4bb6a00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:19.685454 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a27ea3e3-7d71-4f20-9d7a-4701f4bb6a00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:19.687092 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a27ea3e3-7d71-4f20-9d7a-4701f4bb6a00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:19.687713 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a27ea3e3-7d71-4f20-9d7a-4701f4bb6a00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:19.903419 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-54e63b88-350e-401e-a2c9-830fefb5b4be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:19.912645 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-54e63b88-350e-401e-a2c9-830fefb5b4be tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.254841 May 27 09:41:19.913514 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 176/328] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:19 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:19.921581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6a29713e-6020-4d9f-aebe-382af98ade55 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:19.927930 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6a29713e-6020-4d9f-aebe-382af98ade55 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:19.943637 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a27ea3e3-7d71-4f20-9d7a-4701f4bb6a00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:19.947261 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6a29713e-6020-4d9f-aebe-382af98ade55 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:19.951756 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a27ea3e3-7d71-4f20-9d7a-4701f4bb6a00 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.282540 May 27 09:41:19.952495 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6a29713e-6020-4d9f-aebe-382af98ade55 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:19.953571 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6a29713e-6020-4d9f-aebe-382af98ade55 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:19.954918 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6a29713e-6020-4d9f-aebe-382af98ade55 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:19.955352 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 153/329] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:19 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:20.120023 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6a29713e-6020-4d9f-aebe-382af98ade55 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:20.127602 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6a29713e-6020-4d9f-aebe-382af98ade55 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.212825 May 27 09:41:20.128409 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 177/330] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:19 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:20.931256 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5856d7b6-16e1-4c4d-b936-7a5a56cf4e2d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:20.933135 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5856d7b6-16e1-4c4d-b936-7a5a56cf4e2d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:20.941446 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5856d7b6-16e1-4c4d-b936-7a5a56cf4e2d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:20.942045 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5856d7b6-16e1-4c4d-b936-7a5a56cf4e2d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:20.943067 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5856d7b6-16e1-4c4d-b936-7a5a56cf4e2d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:20.943551 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5856d7b6-16e1-4c4d-b936-7a5a56cf4e2d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:20.970425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-01940965-92ed-452e-9d45-7f3fe47cf648 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:20.972171 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-01940965-92ed-452e-9d45-7f3fe47cf648 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:20.978840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-01940965-92ed-452e-9d45-7f3fe47cf648 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:20.979612 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-01940965-92ed-452e-9d45-7f3fe47cf648 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:20.980952 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-01940965-92ed-452e-9d45-7f3fe47cf648 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:20.981739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-01940965-92ed-452e-9d45-7f3fe47cf648 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:21.189597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5856d7b6-16e1-4c4d-b936-7a5a56cf4e2d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:21.198581 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5856d7b6-16e1-4c4d-b936-7a5a56cf4e2d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.272064 May 27 09:41:21.204710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 154/331] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:20 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:21.213665 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0b454677-98f5-4fb3-b3d9-03ff6155b695 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:21.215823 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0b454677-98f5-4fb3-b3d9-03ff6155b695 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:21.219460 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-01940965-92ed-452e-9d45-7f3fe47cf648 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:21.228113 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b454677-98f5-4fb3-b3d9-03ff6155b695 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:21.228679 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b454677-98f5-4fb3-b3d9-03ff6155b695 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:21.229537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b454677-98f5-4fb3-b3d9-03ff6155b695 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:21.230212 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b454677-98f5-4fb3-b3d9-03ff6155b695 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:21.231558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-01940965-92ed-452e-9d45-7f3fe47cf648 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.265429 May 27 09:41:21.232330 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 178/332] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:20 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:21.363557 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0b454677-98f5-4fb3-b3d9-03ff6155b695 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:21.371009 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0b454677-98f5-4fb3-b3d9-03ff6155b695 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.165064 May 27 09:41:21.371613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 155/333] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:21 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:22.222321 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b5da092b-e30a-4481-8d74-5ac2448e8b23 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:22.222938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b5da092b-e30a-4481-8d74-5ac2448e8b23 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:22.229180 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b5da092b-e30a-4481-8d74-5ac2448e8b23 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:22.229626 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b5da092b-e30a-4481-8d74-5ac2448e8b23 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:22.230392 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b5da092b-e30a-4481-8d74-5ac2448e8b23 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:22.230841 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b5da092b-e30a-4481-8d74-5ac2448e8b23 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:22.249686 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-868b1739-5875-4bbe-ba60-91c43bc7b8c7 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:22.250299 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-868b1739-5875-4bbe-ba60-91c43bc7b8c7 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:22.251545 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=100 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:22.256734 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-868b1739-5875-4bbe-ba60-91c43bc7b8c7 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:22.257186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-868b1739-5875-4bbe-ba60-91c43bc7b8c7 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:22.257970 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-868b1739-5875-4bbe-ba60-91c43bc7b8c7 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:22.258406 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-868b1739-5875-4bbe-ba60-91c43bc7b8c7 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:22.439715 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b5da092b-e30a-4481-8d74-5ac2448e8b23 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:22.443090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-868b1739-5875-4bbe-ba60-91c43bc7b8c7 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:22.447340 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b5da092b-e30a-4481-8d74-5ac2448e8b23 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.229547 May 27 09:41:22.447908 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 179/334] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:22 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:22.450764 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-868b1739-5875-4bbe-ba60-91c43bc7b8c7 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.205623 May 27 09:41:22.451591 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 156/335] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:22 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:22.452294 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-436c8eb2-0878-4865-9bb1-f4015f071d80 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:22.452895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-436c8eb2-0878-4865-9bb1-f4015f071d80 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:22.458755 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-436c8eb2-0878-4865-9bb1-f4015f071d80 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:22.459201 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-436c8eb2-0878-4865-9bb1-f4015f071d80 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:22.459996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-436c8eb2-0878-4865-9bb1-f4015f071d80 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:22.460432 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-436c8eb2-0878-4865-9bb1-f4015f071d80 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:22.596741 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-436c8eb2-0878-4865-9bb1-f4015f071d80 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:22.606057 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-436c8eb2-0878-4865-9bb1-f4015f071d80 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.157126 May 27 09:41:22.606627 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 180/336] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:22 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:23.464260 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f6866362-9e9f-4f0e-aef2-de3b5c89116a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:23.464895 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f6866362-9e9f-4f0e-aef2-de3b5c89116a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:23.466834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e1d3869a-2d51-4cfd-aab3-640a9c67060e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:23.467507 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e1d3869a-2d51-4cfd-aab3-640a9c67060e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:23.469366 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:23.471970 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f6866362-9e9f-4f0e-aef2-de3b5c89116a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:23.472418 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f6866362-9e9f-4f0e-aef2-de3b5c89116a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:23.473221 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f6866362-9e9f-4f0e-aef2-de3b5c89116a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:23.473751 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f6866362-9e9f-4f0e-aef2-de3b5c89116a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:23.476796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e1d3869a-2d51-4cfd-aab3-640a9c67060e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:23.477285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e1d3869a-2d51-4cfd-aab3-640a9c67060e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:23.478071 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e1d3869a-2d51-4cfd-aab3-640a9c67060e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:23.478512 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e1d3869a-2d51-4cfd-aab3-640a9c67060e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:23.669198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f6866362-9e9f-4f0e-aef2-de3b5c89116a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:23.677066 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e1d3869a-2d51-4cfd-aab3-640a9c67060e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:23.677232 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f6866362-9e9f-4f0e-aef2-de3b5c89116a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.216928 May 27 09:41:23.677757 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 157/337] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:23 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:23.682138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d8671b11-b16f-408b-a87e-59b715febd39 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:23.682741 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d8671b11-b16f-408b-a87e-59b715febd39 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:23.684723 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e1d3869a-2d51-4cfd-aab3-640a9c67060e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.221655 May 27 09:41:23.685598 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 181/338] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:23 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:23.688765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8671b11-b16f-408b-a87e-59b715febd39 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:23.689208 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8671b11-b16f-408b-a87e-59b715febd39 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:23.689966 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8671b11-b16f-408b-a87e-59b715febd39 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:23.690400 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8671b11-b16f-408b-a87e-59b715febd39 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:23.818035 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d8671b11-b16f-408b-a87e-59b715febd39 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:23.825354 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d8671b11-b16f-408b-a87e-59b715febd39 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.146669 May 27 09:41:23.825922 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 158/339] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:23 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:24.697191 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-54c4b32e-de5a-4735-9538-293454de4ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:24.697808 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-54c4b32e-de5a-4735-9538-293454de4ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:24.702069 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d4d9deee-395f-4374-8c64-6a236d4f54c0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:24.702681 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d4d9deee-395f-4374-8c64-6a236d4f54c0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:24.704750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54c4b32e-de5a-4735-9538-293454de4ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:24.705226 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54c4b32e-de5a-4735-9538-293454de4ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:24.706018 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54c4b32e-de5a-4735-9538-293454de4ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:24.706474 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54c4b32e-de5a-4735-9538-293454de4ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:24.709727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4d9deee-395f-4374-8c64-6a236d4f54c0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:24.710182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4d9deee-395f-4374-8c64-6a236d4f54c0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:24.710960 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4d9deee-395f-4374-8c64-6a236d4f54c0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:24.711456 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4d9deee-395f-4374-8c64-6a236d4f54c0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:24.908795 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d4d9deee-395f-4374-8c64-6a236d4f54c0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:24.910690 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-54c4b32e-de5a-4735-9538-293454de4ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:24.916725 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d4d9deee-395f-4374-8c64-6a236d4f54c0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.218891 May 27 09:41:24.917295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 159/340] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:24 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:24.918476 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-54c4b32e-de5a-4735-9538-293454de4ac9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.225021 May 27 09:41:24.919247 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 182/341] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:24 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:24.922495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-91fb0019-9325-4c09-9e97-d73ea1b53454 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:24.923101 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-91fb0019-9325-4c09-9e97-d73ea1b53454 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:24.929164 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-91fb0019-9325-4c09-9e97-d73ea1b53454 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:24.929618 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-91fb0019-9325-4c09-9e97-d73ea1b53454 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:24.930382 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-91fb0019-9325-4c09-9e97-d73ea1b53454 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:24.930819 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-91fb0019-9325-4c09-9e97-d73ea1b53454 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:24.935238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=100 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:25.071293 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-91fb0019-9325-4c09-9e97-d73ea1b53454 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:25.080562 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-91fb0019-9325-4c09-9e97-d73ea1b53454 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.162279 May 27 09:41:25.081370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 160/342] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:24 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:25.938878 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-52a65438-f22b-4441-9a79-49be4e705e5e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:25.941606 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d12f76ba-46ec-40a5-bd79-a4ec7b567283 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:25.942512 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d12f76ba-46ec-40a5-bd79-a4ec7b567283 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:25.942963 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-52a65438-f22b-4441-9a79-49be4e705e5e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:25.949579 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d12f76ba-46ec-40a5-bd79-a4ec7b567283 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:25.949944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d12f76ba-46ec-40a5-bd79-a4ec7b567283 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:25.950711 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d12f76ba-46ec-40a5-bd79-a4ec7b567283 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:25.950959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-52a65438-f22b-4441-9a79-49be4e705e5e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:25.951788 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d12f76ba-46ec-40a5-bd79-a4ec7b567283 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:25.952208 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-52a65438-f22b-4441-9a79-49be4e705e5e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:25.953102 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-52a65438-f22b-4441-9a79-49be4e705e5e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:25.953598 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-52a65438-f22b-4441-9a79-49be4e705e5e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:26.155346 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-52a65438-f22b-4441-9a79-49be4e705e5e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:26.172215 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-52a65438-f22b-4441-9a79-49be4e705e5e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.240713 May 27 09:41:26.178350 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 183/343] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:25 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:26.181561 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d12f76ba-46ec-40a5-bd79-a4ec7b567283 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:26.183258 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-377156bb-880d-433d-a41d-a2f8c05c057c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:26.184019 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-377156bb-880d-433d-a41d-a2f8c05c057c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:26.191152 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-377156bb-880d-433d-a41d-a2f8c05c057c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:26.191652 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-377156bb-880d-433d-a41d-a2f8c05c057c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:26.192437 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-377156bb-880d-433d-a41d-a2f8c05c057c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:26.192876 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-377156bb-880d-433d-a41d-a2f8c05c057c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:26.195500 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d12f76ba-46ec-40a5-bd79-a4ec7b567283 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.259683 May 27 09:41:26.196530 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 161/344] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:25 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:26.334544 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-377156bb-880d-433d-a41d-a2f8c05c057c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:26.342417 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-377156bb-880d-433d-a41d-a2f8c05c057c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.162919 May 27 09:41:26.343152 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 184/345] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:26 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:27.191166 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-86645bee-c847-441d-a7ff-975440246fff tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:27.191964 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-86645bee-c847-441d-a7ff-975440246fff tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:27.199995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-86645bee-c847-441d-a7ff-975440246fff tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:27.200613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-86645bee-c847-441d-a7ff-975440246fff tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:27.201535 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-86645bee-c847-441d-a7ff-975440246fff tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:27.202194 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-86645bee-c847-441d-a7ff-975440246fff tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:27.213460 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-13d7bf45-9090-4c76-ac2b-f37da5dff50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:27.214328 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-13d7bf45-9090-4c76-ac2b-f37da5dff50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:27.221187 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-13d7bf45-9090-4c76-ac2b-f37da5dff50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:27.221893 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-13d7bf45-9090-4c76-ac2b-f37da5dff50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:27.222670 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-13d7bf45-9090-4c76-ac2b-f37da5dff50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:27.223101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-13d7bf45-9090-4c76-ac2b-f37da5dff50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:27.415501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-86645bee-c847-441d-a7ff-975440246fff tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:27.424195 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-86645bee-c847-441d-a7ff-975440246fff tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.237331 May 27 09:41:27.434059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 162/346] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:27 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:27.438931 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d8866eb1-5202-45b0-b7f1-32968f5656f1 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:27.439589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d8866eb1-5202-45b0-b7f1-32968f5656f1 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:27.441237 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-13d7bf45-9090-4c76-ac2b-f37da5dff50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:27.445978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8866eb1-5202-45b0-b7f1-32968f5656f1 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:27.446440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8866eb1-5202-45b0-b7f1-32968f5656f1 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:27.447228 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8866eb1-5202-45b0-b7f1-32968f5656f1 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:27.447748 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d8866eb1-5202-45b0-b7f1-32968f5656f1 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:27.449515 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-13d7bf45-9090-4c76-ac2b-f37da5dff50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.240162 May 27 09:41:27.450299 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 185/347] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:27 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:27.578242 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d8866eb1-5202-45b0-b7f1-32968f5656f1 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:27.585999 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d8866eb1-5202-45b0-b7f1-32968f5656f1 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.150757 May 27 09:41:27.586571 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 163/348] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:27 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:28.440985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0c55df4d-2225-4912-8d99-315e826c12ed tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:28.441515 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0c55df4d-2225-4912-8d99-315e826c12ed tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:28.447451 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0c55df4d-2225-4912-8d99-315e826c12ed tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:28.447912 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0c55df4d-2225-4912-8d99-315e826c12ed tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:28.448663 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0c55df4d-2225-4912-8d99-315e826c12ed tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:28.449094 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0c55df4d-2225-4912-8d99-315e826c12ed tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:28.466793 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d4ab72c4-e544-43f1-a82e-15ac4d8003ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:28.466793 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d4ab72c4-e544-43f1-a82e-15ac4d8003ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:28.473698 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4ab72c4-e544-43f1-a82e-15ac4d8003ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:28.474145 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4ab72c4-e544-43f1-a82e-15ac4d8003ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:28.474913 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4ab72c4-e544-43f1-a82e-15ac4d8003ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:28.475375 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4ab72c4-e544-43f1-a82e-15ac4d8003ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:28.656262 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0c55df4d-2225-4912-8d99-315e826c12ed tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:28.663664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0c55df4d-2225-4912-8d99-315e826c12ed tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.227247 May 27 09:41:28.664237 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 186/349] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:28 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:28.668757 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d4ab72c4-e544-43f1-a82e-15ac4d8003ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:28.668929 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b214efde-29d3-4e40-bba4-f304f91e8358 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:28.669390 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b214efde-29d3-4e40-bba4-f304f91e8358 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:28.676137 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b214efde-29d3-4e40-bba4-f304f91e8358 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:28.676589 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b214efde-29d3-4e40-bba4-f304f91e8358 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:28.677226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d4ab72c4-e544-43f1-a82e-15ac4d8003ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.215141 May 27 09:41:28.677389 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b214efde-29d3-4e40-bba4-f304f91e8358 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:28.677802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 164/350] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:28 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:28.677909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b214efde-29d3-4e40-bba4-f304f91e8358 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:28.813751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b214efde-29d3-4e40-bba4-f304f91e8358 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:28.821842 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b214efde-29d3-4e40-bba4-f304f91e8358 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.156606 May 27 09:41:28.822599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 187/351] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:28 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:29.680929 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ff089c94-0df3-4c34-9259-f177bb06d632 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:29.681595 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ff089c94-0df3-4c34-9259-f177bb06d632 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:29.689495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff089c94-0df3-4c34-9259-f177bb06d632 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:29.689883 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff089c94-0df3-4c34-9259-f177bb06d632 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:29.690709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff089c94-0df3-4c34-9259-f177bb06d632 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:29.691179 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff089c94-0df3-4c34-9259-f177bb06d632 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:29.695134 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c3f42c54-a61c-495f-ab76-9518f01c4a46 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:29.695782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c3f42c54-a61c-495f-ab76-9518f01c4a46 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:29.701779 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c3f42c54-a61c-495f-ab76-9518f01c4a46 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:29.702225 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c3f42c54-a61c-495f-ab76-9518f01c4a46 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:29.703604 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c3f42c54-a61c-495f-ab76-9518f01c4a46 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:29.704035 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c3f42c54-a61c-495f-ab76-9518f01c4a46 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:29.881474 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ff089c94-0df3-4c34-9259-f177bb06d632 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:29.888728 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ff089c94-0df3-4c34-9259-f177bb06d632 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.211661 May 27 09:41:29.889300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 165/352] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:29 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:29.895706 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a3b707e0-79be-48f4-9761-84aebf2954f9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:29.896308 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a3b707e0-79be-48f4-9761-84aebf2954f9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:29.902109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3b707e0-79be-48f4-9761-84aebf2954f9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:29.902479 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3b707e0-79be-48f4-9761-84aebf2954f9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:29.903244 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3b707e0-79be-48f4-9761-84aebf2954f9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:29.903703 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3b707e0-79be-48f4-9761-84aebf2954f9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:29.914059 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c3f42c54-a61c-495f-ab76-9518f01c4a46 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:29.921064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c3f42c54-a61c-495f-ab76-9518f01c4a46 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.230725 May 27 09:41:29.922256 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 188/353] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:29 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:30.051594 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a3b707e0-79be-48f4-9761-84aebf2954f9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:30.061869 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a3b707e0-79be-48f4-9761-84aebf2954f9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.171520 May 27 09:41:30.062645 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 166/354] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:29 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:30.905031 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-51e9f04f-4976-45b9-9628-30e6c9f7f514 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:30.906056 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-51e9f04f-4976-45b9-9628-30e6c9f7f514 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:30.912686 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-51e9f04f-4976-45b9-9628-30e6c9f7f514 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:30.913138 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-51e9f04f-4976-45b9-9628-30e6c9f7f514 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:30.913915 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-51e9f04f-4976-45b9-9628-30e6c9f7f514 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:30.914347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-51e9f04f-4976-45b9-9628-30e6c9f7f514 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:30.939791 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-865f25fe-2bb1-4f82-b550-821815faa8c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:30.940491 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-865f25fe-2bb1-4f82-b550-821815faa8c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:30.948242 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-865f25fe-2bb1-4f82-b550-821815faa8c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:30.948810 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-865f25fe-2bb1-4f82-b550-821815faa8c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:30.949686 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-865f25fe-2bb1-4f82-b550-821815faa8c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:30.950309 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-865f25fe-2bb1-4f82-b550-821815faa8c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:31.141559 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-51e9f04f-4976-45b9-9628-30e6c9f7f514 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:31.145531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-865f25fe-2bb1-4f82-b550-821815faa8c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:31.152891 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-51e9f04f-4976-45b9-9628-30e6c9f7f514 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.251595 May 27 09:41:31.153068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-865f25fe-2bb1-4f82-b550-821815faa8c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.217782 May 27 09:41:31.153909 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 167/355] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:30 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:31.155460 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 189/356] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:30 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:31.158816 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4182bafb-c3e3-4bb4-ae24-7b72a2371d73 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:31.159795 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4182bafb-c3e3-4bb4-ae24-7b72a2371d73 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:31.166318 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4182bafb-c3e3-4bb4-ae24-7b72a2371d73 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:31.166771 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4182bafb-c3e3-4bb4-ae24-7b72a2371d73 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:31.167605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4182bafb-c3e3-4bb4-ae24-7b72a2371d73 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:31.168046 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4182bafb-c3e3-4bb4-ae24-7b72a2371d73 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:31.294481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4182bafb-c3e3-4bb4-ae24-7b72a2371d73 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:31.302930 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4182bafb-c3e3-4bb4-ae24-7b72a2371d73 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.148292 May 27 09:41:31.303539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 168/357] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:31 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:32.172211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6601fcd1-1fa9-4252-a9e1-3bd26e53a448 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:32.172814 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6601fcd1-1fa9-4252-a9e1-3bd26e53a448 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:32.175314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1404dd92-4923-4c04-8e04-ad0457f86c18 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:32.175930 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1404dd92-4923-4c04-8e04-ad0457f86c18 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:32.178777 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6601fcd1-1fa9-4252-a9e1-3bd26e53a448 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:32.179228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6601fcd1-1fa9-4252-a9e1-3bd26e53a448 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:32.180017 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6601fcd1-1fa9-4252-a9e1-3bd26e53a448 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:32.180445 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6601fcd1-1fa9-4252-a9e1-3bd26e53a448 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:32.182226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1404dd92-4923-4c04-8e04-ad0457f86c18 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:32.182673 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1404dd92-4923-4c04-8e04-ad0457f86c18 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:32.183538 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1404dd92-4923-4c04-8e04-ad0457f86c18 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:32.183980 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1404dd92-4923-4c04-8e04-ad0457f86c18 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:32.368942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6601fcd1-1fa9-4252-a9e1-3bd26e53a448 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:32.372050 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1404dd92-4923-4c04-8e04-ad0457f86c18 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:32.378963 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6601fcd1-1fa9-4252-a9e1-3bd26e53a448 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.211053 May 27 09:41:32.383755 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 190/358] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:32 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:32.383895 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1404dd92-4923-4c04-8e04-ad0457f86c18 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.209473 May 27 09:41:32.383895 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 169/359] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:32 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:32.384194 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4f85f493-3f51-42d8-9398-f9e52e14d636 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:32.384968 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4f85f493-3f51-42d8-9398-f9e52e14d636 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:32.391475 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4f85f493-3f51-42d8-9398-f9e52e14d636 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:32.391922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4f85f493-3f51-42d8-9398-f9e52e14d636 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:32.392687 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4f85f493-3f51-42d8-9398-f9e52e14d636 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:32.393117 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4f85f493-3f51-42d8-9398-f9e52e14d636 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:32.523782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4f85f493-3f51-42d8-9398-f9e52e14d636 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:32.531020 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4f85f493-3f51-42d8-9398-f9e52e14d636 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.150524 May 27 09:41:32.531616 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 191/360] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:32 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:33.395465 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f0107f03-f1ca-4003-8614-9bc7fe000fa5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:33.396162 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f0107f03-f1ca-4003-8614-9bc7fe000fa5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:33.397759 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-901d1547-3c92-4ced-8547-9ebbbaec8eb8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:33.398368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-901d1547-3c92-4ced-8547-9ebbbaec8eb8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:33.402516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f0107f03-f1ca-4003-8614-9bc7fe000fa5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:33.402960 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f0107f03-f1ca-4003-8614-9bc7fe000fa5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:33.403739 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f0107f03-f1ca-4003-8614-9bc7fe000fa5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:33.404169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f0107f03-f1ca-4003-8614-9bc7fe000fa5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:33.404272 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-901d1547-3c92-4ced-8547-9ebbbaec8eb8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:33.404657 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-901d1547-3c92-4ced-8547-9ebbbaec8eb8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:33.405412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-901d1547-3c92-4ced-8547-9ebbbaec8eb8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:33.405843 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-901d1547-3c92-4ced-8547-9ebbbaec8eb8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:33.592835 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f0107f03-f1ca-4003-8614-9bc7fe000fa5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:33.600356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-901d1547-3c92-4ced-8547-9ebbbaec8eb8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:33.600612 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f0107f03-f1ca-4003-8614-9bc7fe000fa5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.209531 May 27 09:41:33.601188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 170/361] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:33 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:33.605571 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b3ce5149-f2dd-4d49-b4e9-715d0a692291 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:33.606176 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b3ce5149-f2dd-4d49-b4e9-715d0a692291 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:33.607846 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-901d1547-3c92-4ced-8547-9ebbbaec8eb8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.213990 May 27 09:41:33.608556 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 192/362] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:33 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:33.612974 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b3ce5149-f2dd-4d49-b4e9-715d0a692291 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:33.613465 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b3ce5149-f2dd-4d49-b4e9-715d0a692291 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:33.614276 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b3ce5149-f2dd-4d49-b4e9-715d0a692291 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:33.614717 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b3ce5149-f2dd-4d49-b4e9-715d0a692291 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:33.743726 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b3ce5149-f2dd-4d49-b4e9-715d0a692291 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:33.751584 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b3ce5149-f2dd-4d49-b4e9-715d0a692291 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.149369 May 27 09:41:33.752147 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 171/363] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:33 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:34.617255 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e3747da7-4c9a-486c-ae3d-00dde074689c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:34.617859 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e3747da7-4c9a-486c-ae3d-00dde074689c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:34.623859 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e3747da7-4c9a-486c-ae3d-00dde074689c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:34.624301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e3747da7-4c9a-486c-ae3d-00dde074689c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:34.624712 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-35f497b6-3a3c-4a42-bf97-25243b3b2a32 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:34.625162 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e3747da7-4c9a-486c-ae3d-00dde074689c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:34.625395 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-35f497b6-3a3c-4a42-bf97-25243b3b2a32 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:34.625505 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e3747da7-4c9a-486c-ae3d-00dde074689c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:34.631739 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35f497b6-3a3c-4a42-bf97-25243b3b2a32 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:34.632181 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35f497b6-3a3c-4a42-bf97-25243b3b2a32 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:34.632940 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35f497b6-3a3c-4a42-bf97-25243b3b2a32 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:34.633376 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35f497b6-3a3c-4a42-bf97-25243b3b2a32 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:34.838091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e3747da7-4c9a-486c-ae3d-00dde074689c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:34.840561 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-35f497b6-3a3c-4a42-bf97-25243b3b2a32 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:34.845554 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e3747da7-4c9a-486c-ae3d-00dde074689c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.231984 May 27 09:41:34.846212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 193/364] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:34 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:34.848619 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-35f497b6-3a3c-4a42-bf97-25243b3b2a32 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.227828 May 27 09:41:34.849327 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 172/365] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:34 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:34.851013 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bd880a19-5f52-4cf3-adb8-83336189a415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:34.851664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bd880a19-5f52-4cf3-adb8-83336189a415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:34.857429 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd880a19-5f52-4cf3-adb8-83336189a415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:34.857783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd880a19-5f52-4cf3-adb8-83336189a415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:34.858534 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd880a19-5f52-4cf3-adb8-83336189a415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:34.858961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd880a19-5f52-4cf3-adb8-83336189a415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:34.981700 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bd880a19-5f52-4cf3-adb8-83336189a415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:34.989174 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bd880a19-5f52-4cf3-adb8-83336189a415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.141821 May 27 09:41:34.989755 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 194/366] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:34 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:35.863533 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-bcc1ca52-6442-4370-9949-e856db9fd4d5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:35.864048 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bcc1ca52-6442-4370-9949-e856db9fd4d5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:35.865819 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-75544416-ea35-4c57-a71a-f0ce18df1b36 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:35.866447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-75544416-ea35-4c57-a71a-f0ce18df1b36 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:35.870567 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bcc1ca52-6442-4370-9949-e856db9fd4d5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:35.871025 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bcc1ca52-6442-4370-9949-e856db9fd4d5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:35.871829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bcc1ca52-6442-4370-9949-e856db9fd4d5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:35.872271 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bcc1ca52-6442-4370-9949-e856db9fd4d5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:35.872469 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75544416-ea35-4c57-a71a-f0ce18df1b36 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:35.872917 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75544416-ea35-4c57-a71a-f0ce18df1b36 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:35.873675 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75544416-ea35-4c57-a71a-f0ce18df1b36 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:35.874110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75544416-ea35-4c57-a71a-f0ce18df1b36 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:36.060634 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bcc1ca52-6442-4370-9949-e856db9fd4d5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:36.065147 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-75544416-ea35-4c57-a71a-f0ce18df1b36 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:36.068927 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-bcc1ca52-6442-4370-9949-e856db9fd4d5 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.209927 May 27 09:41:36.069507 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 173/367] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:35 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:36.072511 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-75544416-ea35-4c57-a71a-f0ce18df1b36 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.210552 May 27 09:41:36.073201 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 195/368] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:35 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:36.074186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-640146b1-caf6-4e02-b78b-2b73c54c7bf6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:36.074789 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-640146b1-caf6-4e02-b78b-2b73c54c7bf6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:36.081091 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-640146b1-caf6-4e02-b78b-2b73c54c7bf6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:36.081539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-640146b1-caf6-4e02-b78b-2b73c54c7bf6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:36.082296 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-640146b1-caf6-4e02-b78b-2b73c54c7bf6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:36.082735 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-640146b1-caf6-4e02-b78b-2b73c54c7bf6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:36.206594 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-640146b1-caf6-4e02-b78b-2b73c54c7bf6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:36.214034 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-640146b1-caf6-4e02-b78b-2b73c54c7bf6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.143580 May 27 09:41:36.214605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 174/369] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:36 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:37.085778 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-862a9740-1b58-491f-af9c-93d0d696986d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:37.086387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-862a9740-1b58-491f-af9c-93d0d696986d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:37.089717 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-728c784a-d1d1-4b92-b3ec-8f122e417315 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:37.090422 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-728c784a-d1d1-4b92-b3ec-8f122e417315 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:37.092377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-862a9740-1b58-491f-af9c-93d0d696986d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:37.092821 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-862a9740-1b58-491f-af9c-93d0d696986d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:37.093581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-862a9740-1b58-491f-af9c-93d0d696986d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:37.095706 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-862a9740-1b58-491f-af9c-93d0d696986d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:37.098677 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=100 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:37.100269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-728c784a-d1d1-4b92-b3ec-8f122e417315 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:37.100788 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-728c784a-d1d1-4b92-b3ec-8f122e417315 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:37.101567 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-728c784a-d1d1-4b92-b3ec-8f122e417315 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:37.101999 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-728c784a-d1d1-4b92-b3ec-8f122e417315 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:37.283832 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-862a9740-1b58-491f-af9c-93d0d696986d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:37.290095 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-728c784a-d1d1-4b92-b3ec-8f122e417315 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:37.298102 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-862a9740-1b58-491f-af9c-93d0d696986d tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.216200 May 27 09:41:37.298468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-728c784a-d1d1-4b92-b3ec-8f122e417315 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.212776 May 27 09:41:37.305971 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 196/370] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:37 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:37.306128 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 175/371] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:37 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:37.306214 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f763f443-7332-4a3d-b139-b28d65f310d5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:37.306214 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f763f443-7332-4a3d-b139-b28d65f310d5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:37.309967 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f763f443-7332-4a3d-b139-b28d65f310d5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:37.310452 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f763f443-7332-4a3d-b139-b28d65f310d5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:37.311218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f763f443-7332-4a3d-b139-b28d65f310d5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:37.311680 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f763f443-7332-4a3d-b139-b28d65f310d5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:37.492855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f763f443-7332-4a3d-b139-b28d65f310d5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:37.502280 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f763f443-7332-4a3d-b139-b28d65f310d5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.202123 May 27 09:41:37.503069 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 197/372] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:37 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:38.315681 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c4201de6-c81f-4fd3-b967-b1e54a5f5430 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:38.316284 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c4201de6-c81f-4fd3-b967-b1e54a5f5430 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:38.324363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4b8ad246-7d87-496e-9e67-414067725abb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:38.324866 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4b8ad246-7d87-496e-9e67-414067725abb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:38.338827 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4b8ad246-7d87-496e-9e67-414067725abb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:38.339342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4b8ad246-7d87-496e-9e67-414067725abb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:38.340860 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4b8ad246-7d87-496e-9e67-414067725abb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:38.341465 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4b8ad246-7d87-496e-9e67-414067725abb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:38.348195 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c4201de6-c81f-4fd3-b967-b1e54a5f5430 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:38.348639 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c4201de6-c81f-4fd3-b967-b1e54a5f5430 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:38.349596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c4201de6-c81f-4fd3-b967-b1e54a5f5430 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:38.350180 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c4201de6-c81f-4fd3-b967-b1e54a5f5430 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:38.547707 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4b8ad246-7d87-496e-9e67-414067725abb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:38.555637 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4b8ad246-7d87-496e-9e67-414067725abb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.235217 May 27 09:41:38.556205 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 198/373] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:38 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:38.560458 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-d757d2b1-2102-4ff5-a3aa-bbc8903cd451 req-70f6d031-921f-44e7-a171-97f3c527c7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd942627-ce67-4a65-95dc-a589397bd130", "tag": "7adfbb2e-f976-47e6-8ad5-c96c45292acc"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:41:38.568295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-d757d2b1-2102-4ff5-a3aa-bbc8903cd451 req-70f6d031-921f-44e7-a171-97f3c527c7eb service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:38.568733 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-d757d2b1-2102-4ff5-a3aa-bbc8903cd451 req-70f6d031-921f-44e7-a171-97f3c527c7eb service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:38.570302 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c4201de6-c81f-4fd3-b967-b1e54a5f5430 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:38.574865 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=100 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:38.580033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c4201de6-c81f-4fd3-b967-b1e54a5f5430 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.268685 May 27 09:41:38.580196 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-d757d2b1-2102-4ff5-a3aa-bbc8903cd451 req-70f6d031-921f-44e7-a171-97f3c527c7eb service nova] Creating event network-changed:7adfbb2e-f976-47e6-8ad5-c96c45292acc for instance cd942627-ce67-4a65-95dc-a589397bd130 on hv-cinder-79760 May 27 09:41:38.580942 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 176/374] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:38 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:38.585851 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-00cad98a-166d-4834-aaef-83f2c7a22d40 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:38.586457 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-00cad98a-166d-4834-aaef-83f2c7a22d40 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:38.592118 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-d757d2b1-2102-4ff5-a3aa-bbc8903cd451 req-70f6d031-921f-44e7-a171-97f3c527c7eb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034717 May 27 09:41:38.592509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-00cad98a-166d-4834-aaef-83f2c7a22d40 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:38.592870 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 199/375] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:41:38.593089 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-00cad98a-166d-4834-aaef-83f2c7a22d40 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:38.594248 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-00cad98a-166d-4834-aaef-83f2c7a22d40 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:38.594738 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-00cad98a-166d-4834-aaef-83f2c7a22d40 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:38.720757 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-00cad98a-166d-4834-aaef-83f2c7a22d40 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:38.728516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-00cad98a-166d-4834-aaef-83f2c7a22d40 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.146541 May 27 09:41:38.729269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 177/376] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:38 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:39.572720 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-35f1d624-8333-4fb2-86b1-c85448f841db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:39.573436 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-35f1d624-8333-4fb2-86b1-c85448f841db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:39.580202 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35f1d624-8333-4fb2-86b1-c85448f841db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:39.580639 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35f1d624-8333-4fb2-86b1-c85448f841db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:39.581386 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35f1d624-8333-4fb2-86b1-c85448f841db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:39.581811 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35f1d624-8333-4fb2-86b1-c85448f841db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:39.596597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-87e34403-d727-4890-a71f-ebc2ce42fcc8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:39.597309 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-87e34403-d727-4890-a71f-ebc2ce42fcc8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:39.603682 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-87e34403-d727-4890-a71f-ebc2ce42fcc8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:39.604129 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-87e34403-d727-4890-a71f-ebc2ce42fcc8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:39.604891 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-87e34403-d727-4890-a71f-ebc2ce42fcc8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:39.605328 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-87e34403-d727-4890-a71f-ebc2ce42fcc8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:39.804495 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-35f1d624-8333-4fb2-86b1-c85448f841db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:39.808709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-87e34403-d727-4890-a71f-ebc2ce42fcc8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:39.813011 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-35f1d624-8333-4fb2-86b1-c85448f841db tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.243813 May 27 09:41:39.813587 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 200/377] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:39 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:39.816608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-87e34403-d727-4890-a71f-ebc2ce42fcc8 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.224120 May 27 09:41:39.817338 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 178/378] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:39 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:39.817937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d4e230b9-e1d9-454c-ab26-6e4b0d3ef0d9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:39.818535 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d4e230b9-e1d9-454c-ab26-6e4b0d3ef0d9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:39.824300 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4e230b9-e1d9-454c-ab26-6e4b0d3ef0d9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:39.824741 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4e230b9-e1d9-454c-ab26-6e4b0d3ef0d9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:39.825496 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4e230b9-e1d9-454c-ab26-6e4b0d3ef0d9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:39.825922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4e230b9-e1d9-454c-ab26-6e4b0d3ef0d9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:39.955001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d4e230b9-e1d9-454c-ab26-6e4b0d3ef0d9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:39.962435 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d4e230b9-e1d9-454c-ab26-6e4b0d3ef0d9 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.147849 May 27 09:41:39.962939 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 201/379] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:39 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:40.829885 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dd2db116-dd41-4a9e-b4ee-b46098f703c3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:40.830642 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dd2db116-dd41-4a9e-b4ee-b46098f703c3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:40.833377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bc57bef7-075c-4e18-ac7b-b1fc8224b87c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:40.834123 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bc57bef7-075c-4e18-ac7b-b1fc8224b87c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:40.838014 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd2db116-dd41-4a9e-b4ee-b46098f703c3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:40.838539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd2db116-dd41-4a9e-b4ee-b46098f703c3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:40.839413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd2db116-dd41-4a9e-b4ee-b46098f703c3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:40.839956 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd2db116-dd41-4a9e-b4ee-b46098f703c3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:40.840788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bc57bef7-075c-4e18-ac7b-b1fc8224b87c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:40.841233 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bc57bef7-075c-4e18-ac7b-b1fc8224b87c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:40.841986 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bc57bef7-075c-4e18-ac7b-b1fc8224b87c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:40.842412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bc57bef7-075c-4e18-ac7b-b1fc8224b87c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:41.037507 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dd2db116-dd41-4a9e-b4ee-b46098f703c3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:41.042727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bc57bef7-075c-4e18-ac7b-b1fc8224b87c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:41.045482 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dd2db116-dd41-4a9e-b4ee-b46098f703c3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.219554 May 27 09:41:41.046167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 179/380] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:40 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:41.052408 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-62b1a028-f882-42ef-b93a-5ee27fde017a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:41.053091 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-62b1a028-f882-42ef-b93a-5ee27fde017a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:41.059047 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62b1a028-f882-42ef-b93a-5ee27fde017a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:41.059601 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62b1a028-f882-42ef-b93a-5ee27fde017a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:41.059904 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bc57bef7-075c-4e18-ac7b-b1fc8224b87c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.230125 May 27 09:41:41.060492 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 202/381] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:40 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:41.060621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62b1a028-f882-42ef-b93a-5ee27fde017a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:41.060971 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62b1a028-f882-42ef-b93a-5ee27fde017a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:41.314335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-62b1a028-f882-42ef-b93a-5ee27fde017a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:41.321623 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-62b1a028-f882-42ef-b93a-5ee27fde017a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.273384 May 27 09:41:41.322188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 180/382] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:41 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:42.063025 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0096bb78-0629-4c40-8b56-5e2622d9adef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:42.064205 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0096bb78-0629-4c40-8b56-5e2622d9adef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:42.070394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0096bb78-0629-4c40-8b56-5e2622d9adef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:42.070977 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0096bb78-0629-4c40-8b56-5e2622d9adef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:42.071778 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0096bb78-0629-4c40-8b56-5e2622d9adef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:42.072934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0096bb78-0629-4c40-8b56-5e2622d9adef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:42.077001 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f3a90c49-4eb8-41e0-8c23-fe103f5502a4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:42.078389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f3a90c49-4eb8-41e0-8c23-fe103f5502a4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:42.085030 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3a90c49-4eb8-41e0-8c23-fe103f5502a4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:42.085441 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3a90c49-4eb8-41e0-8c23-fe103f5502a4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:42.086216 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3a90c49-4eb8-41e0-8c23-fe103f5502a4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:42.086653 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3a90c49-4eb8-41e0-8c23-fe103f5502a4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:42.315444 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0096bb78-0629-4c40-8b56-5e2622d9adef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:42.322218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0096bb78-0629-4c40-8b56-5e2622d9adef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.263533 May 27 09:41:42.323163 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 203/383] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:42 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:42.325421 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f3a90c49-4eb8-41e0-8c23-fe103f5502a4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:42.335599 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f3a90c49-4eb8-41e0-8c23-fe103f5502a4 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.262259 May 27 09:41:42.336107 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 181/384] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:42 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:42.347145 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a8816910-856d-4782-8882-752f0666716d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:42.347791 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a8816910-856d-4782-8882-752f0666716d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:42.353725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a8816910-856d-4782-8882-752f0666716d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:42.354166 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a8816910-856d-4782-8882-752f0666716d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:42.354939 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a8816910-856d-4782-8882-752f0666716d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:42.355535 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a8816910-856d-4782-8882-752f0666716d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:42.493463 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a8816910-856d-4782-8882-752f0666716d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:42.501637 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a8816910-856d-4782-8882-752f0666716d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.167546 May 27 09:41:42.502363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 204/385] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:42 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:43.338893 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6cef43a7-b569-47e1-8dbf-7e80b2917c59 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:43.339539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6cef43a7-b569-47e1-8dbf-7e80b2917c59 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:43.346031 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6cef43a7-b569-47e1-8dbf-7e80b2917c59 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:43.346777 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6cef43a7-b569-47e1-8dbf-7e80b2917c59 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:43.347586 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6cef43a7-b569-47e1-8dbf-7e80b2917c59 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:43.348026 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6cef43a7-b569-47e1-8dbf-7e80b2917c59 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:43.352751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b449ff6f-6e62-423c-b7d7-4dcec3ca214f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:43.353364 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b449ff6f-6e62-423c-b7d7-4dcec3ca214f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:43.359206 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b449ff6f-6e62-423c-b7d7-4dcec3ca214f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:43.359727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b449ff6f-6e62-423c-b7d7-4dcec3ca214f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:43.360487 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b449ff6f-6e62-423c-b7d7-4dcec3ca214f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:43.360919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b449ff6f-6e62-423c-b7d7-4dcec3ca214f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:43.542495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6cef43a7-b569-47e1-8dbf-7e80b2917c59 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:43.546305 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b449ff6f-6e62-423c-b7d7-4dcec3ca214f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:43.551230 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6cef43a7-b569-47e1-8dbf-7e80b2917c59 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.216180 May 27 09:41:43.551826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 182/386] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:43 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:43.554279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b449ff6f-6e62-423c-b7d7-4dcec3ca214f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.205311 May 27 09:41:43.554965 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 205/387] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:43 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:43.556372 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8f5070bf-38c5-4769-a22b-bcdc413e0cf7 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:43.556971 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8f5070bf-38c5-4769-a22b-bcdc413e0cf7 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:43.563488 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f5070bf-38c5-4769-a22b-bcdc413e0cf7 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:43.563934 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f5070bf-38c5-4769-a22b-bcdc413e0cf7 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:43.564790 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f5070bf-38c5-4769-a22b-bcdc413e0cf7 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:43.565221 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f5070bf-38c5-4769-a22b-bcdc413e0cf7 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:43.690643 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8f5070bf-38c5-4769-a22b-bcdc413e0cf7 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:43.697987 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8f5070bf-38c5-4769-a22b-bcdc413e0cf7 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.145231 May 27 09:41:43.698554 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 183/388] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:43 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:44.568480 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a27e28d2-8675-49e2-b0d0-1fbab2bc55ec tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:44.569092 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a27e28d2-8675-49e2-b0d0-1fbab2bc55ec tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:44.571327 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7215416f-345b-4fe1-b9e6-41d1ff92e683 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:44.571941 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7215416f-345b-4fe1-b9e6-41d1ff92e683 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:44.575060 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a27e28d2-8675-49e2-b0d0-1fbab2bc55ec tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:44.575564 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a27e28d2-8675-49e2-b0d0-1fbab2bc55ec tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:44.576336 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a27e28d2-8675-49e2-b0d0-1fbab2bc55ec tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:44.576769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a27e28d2-8675-49e2-b0d0-1fbab2bc55ec tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:44.578917 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7215416f-345b-4fe1-b9e6-41d1ff92e683 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:44.579394 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7215416f-345b-4fe1-b9e6-41d1ff92e683 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:44.580155 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7215416f-345b-4fe1-b9e6-41d1ff92e683 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:44.580589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7215416f-345b-4fe1-b9e6-41d1ff92e683 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:44.764971 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a27e28d2-8675-49e2-b0d0-1fbab2bc55ec tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:44.772327 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7215416f-345b-4fe1-b9e6-41d1ff92e683 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:44.773028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a27e28d2-8675-49e2-b0d0-1fbab2bc55ec tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.208465 May 27 09:41:44.773603 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 206/389] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:44 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:44.778235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7961030e-e983-462f-a857-8c9f632b5215 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:44.778835 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7961030e-e983-462f-a857-8c9f632b5215 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:44.780113 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7215416f-345b-4fe1-b9e6-41d1ff92e683 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.212496 May 27 09:41:44.780939 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 184/390] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:44 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:44.785063 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7961030e-e983-462f-a857-8c9f632b5215 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:44.785509 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7961030e-e983-462f-a857-8c9f632b5215 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:44.786309 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7961030e-e983-462f-a857-8c9f632b5215 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:44.786739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7961030e-e983-462f-a857-8c9f632b5215 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:44.911754 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7961030e-e983-462f-a857-8c9f632b5215 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:44.918997 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7961030e-e983-462f-a857-8c9f632b5215 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.144460 May 27 09:41:44.919592 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 207/391] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:44 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:45.789631 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7b61d969-c9eb-4162-92bf-0c3b678bcb31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:45.790236 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7b61d969-c9eb-4162-92bf-0c3b678bcb31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:45.796520 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7b61d969-c9eb-4162-92bf-0c3b678bcb31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:45.796734 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f0abed08-cb5f-47b4-86b0-fc6612a6c07e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:45.797274 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7b61d969-c9eb-4162-92bf-0c3b678bcb31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:45.797421 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f0abed08-cb5f-47b4-86b0-fc6612a6c07e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:45.797713 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7b61d969-c9eb-4162-92bf-0c3b678bcb31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:45.798142 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7b61d969-c9eb-4162-92bf-0c3b678bcb31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:45.803385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f0abed08-cb5f-47b4-86b0-fc6612a6c07e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:45.803834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f0abed08-cb5f-47b4-86b0-fc6612a6c07e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:45.804588 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f0abed08-cb5f-47b4-86b0-fc6612a6c07e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:45.805020 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f0abed08-cb5f-47b4-86b0-fc6612a6c07e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:46.007577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7b61d969-c9eb-4162-92bf-0c3b678bcb31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:46.011461 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f0abed08-cb5f-47b4-86b0-fc6612a6c07e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:46.016095 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7b61d969-c9eb-4162-92bf-0c3b678bcb31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.229870 May 27 09:41:46.016661 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 185/392] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:45 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:46.019564 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f0abed08-cb5f-47b4-86b0-fc6612a6c07e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1314 microversion: 2.1 time: 0.226559 May 27 09:41:46.020270 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 208/393] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:45 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:46.021027 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0193be73-0fe7-442a-a1d4-5c8b39a4bf82 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:46.021625 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0193be73-0fe7-442a-a1d4-5c8b39a4bf82 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:46.027456 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0193be73-0fe7-442a-a1d4-5c8b39a4bf82 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:46.027906 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0193be73-0fe7-442a-a1d4-5c8b39a4bf82 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:46.028710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0193be73-0fe7-442a-a1d4-5c8b39a4bf82 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:46.029144 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0193be73-0fe7-442a-a1d4-5c8b39a4bf82 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:46.087394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c6c1a3c8-f5a5-4cdd-ad0f-b6c23fc9e22d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e681cdd-fec4-4cdf-83e7-bba43426b212", "device": "/dev/sdb"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:41:46.090111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c6c1a3c8-f5a5-4cdd-ad0f-b6c23fc9e22d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:46.096969 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6c1a3c8-f5a5-4cdd-ad0f-b6c23fc9e22d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:46.097491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6c1a3c8-f5a5-4cdd-ad0f-b6c23fc9e22d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:46.098477 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6c1a3c8-f5a5-4cdd-ad0f-b6c23fc9e22d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:46.099235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6c1a3c8-f5a5-4cdd-ad0f-b6c23fc9e22d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:46.184516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0193be73-0fe7-442a-a1d4-5c8b39a4bf82 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:46.193381 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0193be73-0fe7-442a-a1d4-5c8b39a4bf82 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.175725 May 27 09:41:46.194576 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 186/394] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:46 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:47.034272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-46812825-d91a-4085-a11a-9d6fca31c765 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:47.034956 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-46812825-d91a-4085-a11a-9d6fca31c765 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:47.041536 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-46812825-d91a-4085-a11a-9d6fca31c765 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.042060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-46812825-d91a-4085-a11a-9d6fca31c765 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.042935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-46812825-d91a-4085-a11a-9d6fca31c765 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.043466 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-46812825-d91a-4085-a11a-9d6fca31c765 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.189595 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-46812825-d91a-4085-a11a-9d6fca31c765 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:47.197258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-46812825-d91a-4085-a11a-9d6fca31c765 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1502 microversion: 2.1 time: 0.167890 May 27 09:41:47.197832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 187/395] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:47 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:47.202198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b732ceea-04e8-4bde-b6f6-0228c45e2d1f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:47.203331 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b732ceea-04e8-4bde-b6f6-0228c45e2d1f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:47.209274 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b732ceea-04e8-4bde-b6f6-0228c45e2d1f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.209721 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b732ceea-04e8-4bde-b6f6-0228c45e2d1f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.210480 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b732ceea-04e8-4bde-b6f6-0228c45e2d1f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.210915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b732ceea-04e8-4bde-b6f6-0228c45e2d1f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.339902 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b732ceea-04e8-4bde-b6f6-0228c45e2d1f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:47.348311 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b732ceea-04e8-4bde-b6f6-0228c45e2d1f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1499 microversion: 2.1 time: 0.149510 May 27 09:41:47.348878 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 188/396] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:47 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1499 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:47.353239 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8038360e-51fa-42b7-9a77-e572bc153bd5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:47.353834 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8038360e-51fa-42b7-9a77-e572bc153bd5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:47.359825 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8038360e-51fa-42b7-9a77-e572bc153bd5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.360275 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8038360e-51fa-42b7-9a77-e572bc153bd5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.361050 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8038360e-51fa-42b7-9a77-e572bc153bd5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.361452 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8038360e-51fa-42b7-9a77-e572bc153bd5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.496254 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8038360e-51fa-42b7-9a77-e572bc153bd5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:47.504374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8038360e-51fa-42b7-9a77-e572bc153bd5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.154339 May 27 09:41:47.504946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 189/397] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:47 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:47.509510 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-07d03643-d0db-4aff-b5c5-c15fb6475f1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7fd5845-564b-4b76-9731-45417adecc66"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:41:47.510664 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-07d03643-d0db-4aff-b5c5-c15fb6475f1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:47.516923 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-07d03643-d0db-4aff-b5c5-c15fb6475f1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.517373 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-07d03643-d0db-4aff-b5c5-c15fb6475f1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.518131 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-07d03643-d0db-4aff-b5c5-c15fb6475f1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.518568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-07d03643-d0db-4aff-b5c5-c15fb6475f1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.541602 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-07d03643-d0db-4aff-b5c5-c15fb6475f1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] HTTP exception thrown: Cannot 'attach_volume' instance abf3a64e-1d00-4751-816f-74abd2af6e39 while it is in vm_state rescued May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-07d03643-d0db-4aff-b5c5-c15fb6475f1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Request method failure captured: May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: POST /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39/os-volume_attachments HTTP/1.1 May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 74 May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJw8E69kc370trEXLpeY6UITestdwiquS5mhSQcfPgVOJi0R1BN1wUgAoLk7mJ_L26eDt4wZYQTLjuroG7w77s0HjSvRGsjWg8o4I5dW0q4LWmFIv0U1ANsH9YdQbasIIX2q8iO712z46SNFk9oHoWfSqkGNcR1-QodSA-SM0eE8kFI May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 0cad683f27d14cf5a90a19525a467a52 May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:41:47.543443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0cad683f27d14cf5a90a19525a467a52"}]}] May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 0cad683f27d14cf5a90a19525a467a52 May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-ServerRescueNegativeTestJSON-221303946-project May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 1331ba69eaec44dd9bd8f8db7d53ba5c May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-ServerRescueNegativeTestJSON-221303946-project May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {"volumeAttachment": {"volumeId": "b7fd5845-564b-4b76-9731-45417adecc66"}} May 27 09:41:47.544994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Cannot 'attach_volume' instance abf3a64e-1d00-4751-816f-74abd2af6e39 while it is in vm_state rescued May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'server_id': 'abf3a64e-1d00-4751-816f-74abd2af6e39', 'body': {'volumeAttachment': {'volumeId': 'b7fd5845-564b-4b76-9731-45417adecc66'}}} May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance abf3a64e-1d00-4751-816f-74abd2af6e39 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:41:47.545881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance abf3a64e-1d00-4751-816f-74abd2af6e39 while it is in vm_state rescued May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:41:47.547357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:41:47.548648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:41:47.548648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:41:47.548648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance abf3a64e-1d00-4751-816f-74abd2af6e39 while it is in vm_state rescued May 27 09:41:47.548648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:41:47.548648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-07d03643-d0db-4aff-b5c5-c15fb6475f1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Returning 409 to user: Cannot 'attach_volume' instance abf3a64e-1d00-4751-816f-74abd2af6e39 while it is in vm_state rescued {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:41:47.548648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-07d03643-d0db-4aff-b5c5-c15fb6475f1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038946 May 27 09:41:47.548648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 190/398] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:41:47 2022] POST /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 09:41:47.554722 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5dda8a2d-be2f-49d3-aa9d-b629920ff49b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:41:47.555547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5dda8a2d-be2f-49d3-aa9d-b629920ff49b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:47.561568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dda8a2d-be2f-49d3-aa9d-b629920ff49b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.562010 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dda8a2d-be2f-49d3-aa9d-b629920ff49b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.564106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dda8a2d-be2f-49d3-aa9d-b629920ff49b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.564553 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dda8a2d-be2f-49d3-aa9d-b629920ff49b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.653261 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5dda8a2d-be2f-49d3-aa9d-b629920ff49b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39/action" status: 202 len: 0 microversion: 2.1 time: 0.102761 May 27 09:41:47.659147 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 191/399] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:41:47 2022] POST /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:41:47.665200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ff259f47-b95f-4004-a332-c353deaa37ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:47.666007 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ff259f47-b95f-4004-a332-c353deaa37ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:47.681426 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff259f47-b95f-4004-a332-c353deaa37ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.682010 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff259f47-b95f-4004-a332-c353deaa37ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.683474 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff259f47-b95f-4004-a332-c353deaa37ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.683918 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff259f47-b95f-4004-a332-c353deaa37ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.732044 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c6c1a3c8-f5a5-4cdd-ad0f-b6c23fc9e22d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "POST /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.648327 May 27 09:41:47.732710 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 209/400] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:41:46 2022] POST /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349/os-volume_attachments => generated 194 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:41:48.027663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ff259f47-b95f-4004-a332-c353deaa37ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:48.031500 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:48.042698 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ff259f47-b95f-4004-a332-c353deaa37ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.382017 May 27 09:41:48.043408 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 192/401] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:47 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:48.522486 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-02f025f2-4fe6-41cf-9325-bd3fd463722f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:48.523672 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-02f025f2-4fe6-41cf-9325-bd3fd463722f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:48.530449 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-02f025f2-4fe6-41cf-9325-bd3fd463722f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:48.531631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-02f025f2-4fe6-41cf-9325-bd3fd463722f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:48.532427 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-02f025f2-4fe6-41cf-9325-bd3fd463722f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:48.532869 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-02f025f2-4fe6-41cf-9325-bd3fd463722f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:48.655587 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c1b85c7f-13a9-478d-973b-4e222cd27aab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:48.656844 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c1b85c7f-13a9-478d-973b-4e222cd27aab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:48.664607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1b85c7f-13a9-478d-973b-4e222cd27aab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:48.665168 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1b85c7f-13a9-478d-973b-4e222cd27aab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:48.666047 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1b85c7f-13a9-478d-973b-4e222cd27aab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:48.666629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1b85c7f-13a9-478d-973b-4e222cd27aab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:48.671637 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-02f025f2-4fe6-41cf-9325-bd3fd463722f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:48.679323 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-02f025f2-4fe6-41cf-9325-bd3fd463722f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.161646 May 27 09:41:48.689059 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 210/402] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:48 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:48.694516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c1b85c7f-13a9-478d-973b-4e222cd27aab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:41:48.754162 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=84 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:48.769886 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c1b85c7f-13a9-478d-973b-4e222cd27aab tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 204 len: 0 microversion: 2.1 time: 0.119340 May 27 09:41:48.770629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 193/403] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:41:48 2022] DELETE /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:41:48.779641 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-162f9e61-8d05-4598-be98-952d425fef12 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:48.780583 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-162f9e61-8d05-4598-be98-952d425fef12 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:48.788291 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-162f9e61-8d05-4598-be98-952d425fef12 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:48.788887 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-162f9e61-8d05-4598-be98-952d425fef12 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:48.789668 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-162f9e61-8d05-4598-be98-952d425fef12 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:48.790108 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-162f9e61-8d05-4598-be98-952d425fef12 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:48.931770 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-162f9e61-8d05-4598-be98-952d425fef12 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:48.941697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-162f9e61-8d05-4598-be98-952d425fef12 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.166643 May 27 09:41:48.943536 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 211/404] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:48 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:49.061480 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a5c24f58-65f3-4a71-bd6a-b7951ae2dc45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:49.062691 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a5c24f58-65f3-4a71-bd6a-b7951ae2dc45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:49.069250 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a5c24f58-65f3-4a71-bd6a-b7951ae2dc45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:49.069700 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a5c24f58-65f3-4a71-bd6a-b7951ae2dc45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:49.070471 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a5c24f58-65f3-4a71-bd6a-b7951ae2dc45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:49.070906 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a5c24f58-65f3-4a71-bd6a-b7951ae2dc45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:49.203463 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a5c24f58-65f3-4a71-bd6a-b7951ae2dc45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:49.210915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a5c24f58-65f3-4a71-bd6a-b7951ae2dc45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.153602 May 27 09:41:49.211504 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 194/405] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:49 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:49.695773 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0e63c2c6-7f3b-41f1-837d-b83bb0e57d8f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:49.696382 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0e63c2c6-7f3b-41f1-837d-b83bb0e57d8f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:49.702768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0e63c2c6-7f3b-41f1-837d-b83bb0e57d8f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:49.703210 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0e63c2c6-7f3b-41f1-837d-b83bb0e57d8f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:49.704007 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0e63c2c6-7f3b-41f1-837d-b83bb0e57d8f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:49.704442 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0e63c2c6-7f3b-41f1-837d-b83bb0e57d8f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:49.707032 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:49.830086 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0e63c2c6-7f3b-41f1-837d-b83bb0e57d8f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:49.837526 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0e63c2c6-7f3b-41f1-837d-b83bb0e57d8f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.145550 May 27 09:41:49.838088 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 212/406] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:49 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:49.958792 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4eac4303-ecf0-443f-9147-6ee00142070a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:49.959442 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4eac4303-ecf0-443f-9147-6ee00142070a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:49.965341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4eac4303-ecf0-443f-9147-6ee00142070a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:49.965790 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4eac4303-ecf0-443f-9147-6ee00142070a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:49.966554 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4eac4303-ecf0-443f-9147-6ee00142070a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:49.966989 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4eac4303-ecf0-443f-9147-6ee00142070a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:50.103076 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4eac4303-ecf0-443f-9147-6ee00142070a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:50.111077 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4eac4303-ecf0-443f-9147-6ee00142070a tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.156089 May 27 09:41:50.111672 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 195/407] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:49 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:50.230439 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8465b4ef-6f09-433a-879f-78a0e6c35874 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:50.230958 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8465b4ef-6f09-433a-879f-78a0e6c35874 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:50.237032 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8465b4ef-6f09-433a-879f-78a0e6c35874 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:50.237473 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8465b4ef-6f09-433a-879f-78a0e6c35874 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:50.238224 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8465b4ef-6f09-433a-879f-78a0e6c35874 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:50.238652 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8465b4ef-6f09-433a-879f-78a0e6c35874 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:50.365542 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8465b4ef-6f09-433a-879f-78a0e6c35874 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:50.372773 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8465b4ef-6f09-433a-879f-78a0e6c35874 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.146204 May 27 09:41:50.373318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 213/408] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:50 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:50.854874 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d7eee610-bf4a-4670-b658-4e5eefc11d83 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:50.855544 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d7eee610-bf4a-4670-b658-4e5eefc11d83 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:50.862196 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d7eee610-bf4a-4670-b658-4e5eefc11d83 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:50.862646 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d7eee610-bf4a-4670-b658-4e5eefc11d83 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:50.863448 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d7eee610-bf4a-4670-b658-4e5eefc11d83 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:50.863904 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d7eee610-bf4a-4670-b658-4e5eefc11d83 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:50.989894 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d7eee610-bf4a-4670-b658-4e5eefc11d83 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:50.997165 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d7eee610-bf4a-4670-b658-4e5eefc11d83 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.146099 May 27 09:41:50.997763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 196/409] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:50 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:51.128001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-346a5e7a-4924-42e2-ad68-b7d9491752e9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:51.128605 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-346a5e7a-4924-42e2-ad68-b7d9491752e9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:51.134893 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-346a5e7a-4924-42e2-ad68-b7d9491752e9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:51.135362 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-346a5e7a-4924-42e2-ad68-b7d9491752e9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:51.136111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-346a5e7a-4924-42e2-ad68-b7d9491752e9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:51.136540 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-346a5e7a-4924-42e2-ad68-b7d9491752e9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:51.260758 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-346a5e7a-4924-42e2-ad68-b7d9491752e9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:51.268645 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-346a5e7a-4924-42e2-ad68-b7d9491752e9 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.144463 May 27 09:41:51.269205 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 214/410] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:51 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:51.389424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-56245d91-5d26-469e-8c69-a4df986928bf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:51.390035 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-56245d91-5d26-469e-8c69-a4df986928bf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:51.397187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-56245d91-5d26-469e-8c69-a4df986928bf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:51.397636 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-56245d91-5d26-469e-8c69-a4df986928bf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:51.398402 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-56245d91-5d26-469e-8c69-a4df986928bf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:51.398843 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-56245d91-5d26-469e-8c69-a4df986928bf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:51.522490 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-56245d91-5d26-469e-8c69-a4df986928bf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:51.529873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-56245d91-5d26-469e-8c69-a4df986928bf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.144307 May 27 09:41:51.530443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 197/411] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:51 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:52.014896 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-78c4c46a-0515-4e9f-a0b4-2c5c8f6fe5ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:52.015479 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-78c4c46a-0515-4e9f-a0b4-2c5c8f6fe5ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:52.021285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-78c4c46a-0515-4e9f-a0b4-2c5c8f6fe5ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:52.021729 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-78c4c46a-0515-4e9f-a0b4-2c5c8f6fe5ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:52.022480 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-78c4c46a-0515-4e9f-a0b4-2c5c8f6fe5ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:52.022904 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-78c4c46a-0515-4e9f-a0b4-2c5c8f6fe5ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:52.159572 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-78c4c46a-0515-4e9f-a0b4-2c5c8f6fe5ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:52.166854 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-78c4c46a-0515-4e9f-a0b4-2c5c8f6fe5ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.155976 May 27 09:41:52.167430 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 215/412] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:52 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:52.285958 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-af975a60-4f07-42df-b55b-bb06a4933442 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:52.286572 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-af975a60-4f07-42df-b55b-bb06a4933442 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:52.292684 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-af975a60-4f07-42df-b55b-bb06a4933442 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:52.293121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-af975a60-4f07-42df-b55b-bb06a4933442 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:52.293878 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-af975a60-4f07-42df-b55b-bb06a4933442 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:52.294302 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-af975a60-4f07-42df-b55b-bb06a4933442 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:52.423304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-af975a60-4f07-42df-b55b-bb06a4933442 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:52.430858 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-af975a60-4f07-42df-b55b-bb06a4933442 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.148822 May 27 09:41:52.431454 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 198/413] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:52 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:52.545821 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-599f35ee-1df7-4f9c-a57d-b56aa315a615 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:52.546336 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-599f35ee-1df7-4f9c-a57d-b56aa315a615 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:52.552267 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-599f35ee-1df7-4f9c-a57d-b56aa315a615 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:52.552712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-599f35ee-1df7-4f9c-a57d-b56aa315a615 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:52.553456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-599f35ee-1df7-4f9c-a57d-b56aa315a615 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:52.553884 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-599f35ee-1df7-4f9c-a57d-b56aa315a615 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:52.682012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-599f35ee-1df7-4f9c-a57d-b56aa315a615 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:52.689346 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-599f35ee-1df7-4f9c-a57d-b56aa315a615 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.147430 May 27 09:41:52.689906 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 216/414] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:52 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:53.183969 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7a0dac52-0003-4384-b5a3-1aeb60ea0761 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:53.184833 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7a0dac52-0003-4384-b5a3-1aeb60ea0761 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:53.190959 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7a0dac52-0003-4384-b5a3-1aeb60ea0761 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:53.191506 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7a0dac52-0003-4384-b5a3-1aeb60ea0761 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:53.192514 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7a0dac52-0003-4384-b5a3-1aeb60ea0761 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:53.192965 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7a0dac52-0003-4384-b5a3-1aeb60ea0761 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:53.319606 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7a0dac52-0003-4384-b5a3-1aeb60ea0761 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:53.326899 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7a0dac52-0003-4384-b5a3-1aeb60ea0761 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.146673 May 27 09:41:53.328068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 199/415] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:53 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:53.448789 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-aa2f451f-14e3-4de6-b268-f80ade77c935 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:53.449398 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-aa2f451f-14e3-4de6-b268-f80ade77c935 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:53.456290 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa2f451f-14e3-4de6-b268-f80ade77c935 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:53.456739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa2f451f-14e3-4de6-b268-f80ade77c935 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:53.457491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa2f451f-14e3-4de6-b268-f80ade77c935 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:53.457924 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa2f451f-14e3-4de6-b268-f80ade77c935 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:53.582620 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-aa2f451f-14e3-4de6-b268-f80ade77c935 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:53.589910 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-aa2f451f-14e3-4de6-b268-f80ade77c935 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.145257 May 27 09:41:53.590469 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 217/416] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:53 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:53.706417 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d79062c3-6996-4b23-9508-7c72716a95ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:53.707183 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d79062c3-6996-4b23-9508-7c72716a95ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:53.713613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d79062c3-6996-4b23-9508-7c72716a95ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:53.714059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d79062c3-6996-4b23-9508-7c72716a95ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:53.714816 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d79062c3-6996-4b23-9508-7c72716a95ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:53.715245 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d79062c3-6996-4b23-9508-7c72716a95ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:53.846352 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d79062c3-6996-4b23-9508-7c72716a95ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:53.853725 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d79062c3-6996-4b23-9508-7c72716a95ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.151769 May 27 09:41:53.854283 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 200/417] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:53 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:54.343587 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-706e9460-4abb-450f-b723-9acc94a9515f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:54.344212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-706e9460-4abb-450f-b723-9acc94a9515f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:54.346259 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=74 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:54.351431 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-706e9460-4abb-450f-b723-9acc94a9515f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:54.351880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-706e9460-4abb-450f-b723-9acc94a9515f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:54.352647 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-706e9460-4abb-450f-b723-9acc94a9515f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:54.353096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-706e9460-4abb-450f-b723-9acc94a9515f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:54.479529 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-706e9460-4abb-450f-b723-9acc94a9515f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:54.487899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-706e9460-4abb-450f-b723-9acc94a9515f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.148399 May 27 09:41:54.488588 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 218/418] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:54 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:54.607362 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8f804a17-dc75-4d8e-9cbd-63942cda3c86 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:54.608128 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8f804a17-dc75-4d8e-9cbd-63942cda3c86 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:54.614869 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f804a17-dc75-4d8e-9cbd-63942cda3c86 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:54.616472 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f804a17-dc75-4d8e-9cbd-63942cda3c86 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:54.617256 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f804a17-dc75-4d8e-9cbd-63942cda3c86 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:54.617730 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f804a17-dc75-4d8e-9cbd-63942cda3c86 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:54.758314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8f804a17-dc75-4d8e-9cbd-63942cda3c86 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:54.769418 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8f804a17-dc75-4d8e-9cbd-63942cda3c86 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.165980 May 27 09:41:54.769992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 201/419] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:54 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:54.869771 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9f34e760-af96-4612-8005-a867f48b4ec7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:54.870380 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9f34e760-af96-4612-8005-a867f48b4ec7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:54.876952 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9f34e760-af96-4612-8005-a867f48b4ec7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:54.877400 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9f34e760-af96-4612-8005-a867f48b4ec7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:54.878155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9f34e760-af96-4612-8005-a867f48b4ec7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:54.878587 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9f34e760-af96-4612-8005-a867f48b4ec7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:55.002909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9f34e760-af96-4612-8005-a867f48b4ec7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:55.010480 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9f34e760-af96-4612-8005-a867f48b4ec7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.144419 May 27 09:41:55.011048 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 219/420] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:54 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:55.504757 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2407a9dc-8f67-4190-954d-595a6a4976d3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:55.505365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2407a9dc-8f67-4190-954d-595a6a4976d3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:55.511426 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2407a9dc-8f67-4190-954d-595a6a4976d3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:55.511816 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2407a9dc-8f67-4190-954d-595a6a4976d3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:55.512576 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2407a9dc-8f67-4190-954d-595a6a4976d3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:55.513011 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2407a9dc-8f67-4190-954d-595a6a4976d3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:55.637839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2407a9dc-8f67-4190-954d-595a6a4976d3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:55.645648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2407a9dc-8f67-4190-954d-595a6a4976d3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.144767 May 27 09:41:55.646248 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 202/421] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:55 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:55.787028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ac70e8b1-e436-46f2-9e21-2092480823eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:55.787664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ac70e8b1-e436-46f2-9e21-2092480823eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:55.794016 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac70e8b1-e436-46f2-9e21-2092480823eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:55.794519 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac70e8b1-e436-46f2-9e21-2092480823eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:55.795297 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac70e8b1-e436-46f2-9e21-2092480823eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:55.795738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac70e8b1-e436-46f2-9e21-2092480823eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:55.919735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ac70e8b1-e436-46f2-9e21-2092480823eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:55.927246 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ac70e8b1-e436-46f2-9e21-2092480823eb tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.143882 May 27 09:41:55.927730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 220/422] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:55 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:56.027109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9fd950e3-2c86-4c64-a172-f8493cb47d31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:56.027750 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9fd950e3-2c86-4c64-a172-f8493cb47d31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:56.034374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fd950e3-2c86-4c64-a172-f8493cb47d31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:56.034824 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fd950e3-2c86-4c64-a172-f8493cb47d31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:56.035619 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fd950e3-2c86-4c64-a172-f8493cb47d31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:56.036063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fd950e3-2c86-4c64-a172-f8493cb47d31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:56.162135 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9fd950e3-2c86-4c64-a172-f8493cb47d31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:56.169500 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9fd950e3-2c86-4c64-a172-f8493cb47d31 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.146113 May 27 09:41:56.170250 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 203/423] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:56 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:56.662767 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-99a5eb4b-da3f-41bc-ac4d-bb01dccebb19 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:56.663316 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-99a5eb4b-da3f-41bc-ac4d-bb01dccebb19 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:56.669371 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-99a5eb4b-da3f-41bc-ac4d-bb01dccebb19 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:56.669812 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-99a5eb4b-da3f-41bc-ac4d-bb01dccebb19 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:56.670555 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-99a5eb4b-da3f-41bc-ac4d-bb01dccebb19 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:56.670982 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-99a5eb4b-da3f-41bc-ac4d-bb01dccebb19 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:56.803575 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-99a5eb4b-da3f-41bc-ac4d-bb01dccebb19 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:56.810909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-99a5eb4b-da3f-41bc-ac4d-bb01dccebb19 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.152190 May 27 09:41:56.811506 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 221/424] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:56 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:56.944969 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8285e215-8fa4-46ad-9b91-2ed81cb33b82 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:56.945531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8285e215-8fa4-46ad-9b91-2ed81cb33b82 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:56.951530 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8285e215-8fa4-46ad-9b91-2ed81cb33b82 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:56.951976 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8285e215-8fa4-46ad-9b91-2ed81cb33b82 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:56.953272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8285e215-8fa4-46ad-9b91-2ed81cb33b82 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:56.953705 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8285e215-8fa4-46ad-9b91-2ed81cb33b82 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:57.081772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8285e215-8fa4-46ad-9b91-2ed81cb33b82 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:57.089116 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8285e215-8fa4-46ad-9b91-2ed81cb33b82 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.148050 May 27 09:41:57.089680 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 204/425] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:56 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:57.187929 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0974f465-440b-47ca-8cbb-b4256ba8ea8e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:57.188536 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0974f465-440b-47ca-8cbb-b4256ba8ea8e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:57.194676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0974f465-440b-47ca-8cbb-b4256ba8ea8e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:57.195165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0974f465-440b-47ca-8cbb-b4256ba8ea8e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:57.195899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0974f465-440b-47ca-8cbb-b4256ba8ea8e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:57.196328 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0974f465-440b-47ca-8cbb-b4256ba8ea8e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:57.528722 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0974f465-440b-47ca-8cbb-b4256ba8ea8e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:57.536135 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0974f465-440b-47ca-8cbb-b4256ba8ea8e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.352068 May 27 09:41:57.536703 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 222/426] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:57 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:57.827677 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9c19b9ef-12bd-459d-a2d0-6507f85c5128 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:57.828211 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9c19b9ef-12bd-459d-a2d0-6507f85c5128 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:57.836000 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c19b9ef-12bd-459d-a2d0-6507f85c5128 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:57.836470 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c19b9ef-12bd-459d-a2d0-6507f85c5128 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:57.837322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c19b9ef-12bd-459d-a2d0-6507f85c5128 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:57.837802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9c19b9ef-12bd-459d-a2d0-6507f85c5128 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:57.971924 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9c19b9ef-12bd-459d-a2d0-6507f85c5128 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:57.979467 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9c19b9ef-12bd-459d-a2d0-6507f85c5128 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.155710 May 27 09:41:57.980032 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 205/427] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:57 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:58.109872 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d979e693-d67c-4302-9ecf-bf6e23643e6c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:58.110406 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d979e693-d67c-4302-9ecf-bf6e23643e6c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:58.117348 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d979e693-d67c-4302-9ecf-bf6e23643e6c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:58.117791 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d979e693-d67c-4302-9ecf-bf6e23643e6c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:58.118548 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d979e693-d67c-4302-9ecf-bf6e23643e6c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:58.120979 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d979e693-d67c-4302-9ecf-bf6e23643e6c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:58.267050 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d979e693-d67c-4302-9ecf-bf6e23643e6c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:58.274392 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d979e693-d67c-4302-9ecf-bf6e23643e6c tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.168493 May 27 09:41:58.274960 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 223/428] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:58 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:58.554156 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a60b3ae3-ac47-42d6-b451-3f2fff3da023 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:58.555884 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a60b3ae3-ac47-42d6-b451-3f2fff3da023 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:58.563915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a60b3ae3-ac47-42d6-b451-3f2fff3da023 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:58.564367 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a60b3ae3-ac47-42d6-b451-3f2fff3da023 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:58.565133 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a60b3ae3-ac47-42d6-b451-3f2fff3da023 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:58.565566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a60b3ae3-ac47-42d6-b451-3f2fff3da023 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:58.692880 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a60b3ae3-ac47-42d6-b451-3f2fff3da023 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:58.700341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a60b3ae3-ac47-42d6-b451-3f2fff3da023 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.150670 May 27 09:41:58.700906 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 206/429] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:58 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:58.996819 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d29ed9c4-7a7e-4e6b-b7ff-4b0210a22897 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:58.997424 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d29ed9c4-7a7e-4e6b-b7ff-4b0210a22897 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:59.004004 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d29ed9c4-7a7e-4e6b-b7ff-4b0210a22897 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:59.004443 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d29ed9c4-7a7e-4e6b-b7ff-4b0210a22897 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:59.005196 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d29ed9c4-7a7e-4e6b-b7ff-4b0210a22897 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:59.005626 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d29ed9c4-7a7e-4e6b-b7ff-4b0210a22897 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:59.133942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d29ed9c4-7a7e-4e6b-b7ff-4b0210a22897 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:59.142076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d29ed9c4-7a7e-4e6b-b7ff-4b0210a22897 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.149158 May 27 09:41:59.142638 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 224/430] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:58 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:59.292059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-bb83caa3-2170-4859-bd57-a9b5a2611602 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:59.292774 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bb83caa3-2170-4859-bd57-a9b5a2611602 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:59.300332 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bb83caa3-2170-4859-bd57-a9b5a2611602 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:59.300777 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bb83caa3-2170-4859-bd57-a9b5a2611602 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:59.301531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bb83caa3-2170-4859-bd57-a9b5a2611602 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:59.301960 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bb83caa3-2170-4859-bd57-a9b5a2611602 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:59.426936 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bb83caa3-2170-4859-bd57-a9b5a2611602 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:59.430306 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:59.435364 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-bb83caa3-2170-4859-bd57-a9b5a2611602 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.147237 May 27 09:41:59.435925 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 207/431] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:59 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:59.721053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ccbb37c2-f8e5-45b1-8cae-88613f2608ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:59.721768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ccbb37c2-f8e5-45b1-8cae-88613f2608ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:59.728044 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ccbb37c2-f8e5-45b1-8cae-88613f2608ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:59.728571 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ccbb37c2-f8e5-45b1-8cae-88613f2608ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:59.729720 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ccbb37c2-f8e5-45b1-8cae-88613f2608ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:59.730165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ccbb37c2-f8e5-45b1-8cae-88613f2608ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:59.869734 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ccbb37c2-f8e5-45b1-8cae-88613f2608ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:59.877032 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ccbb37c2-f8e5-45b1-8cae-88613f2608ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.163157 May 27 09:41:59.877590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 225/432] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:41:59 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:00.159060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dd017c46-15bc-4386-b5c2-a85fec01188c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:00.159714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dd017c46-15bc-4386-b5c2-a85fec01188c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:00.166744 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd017c46-15bc-4386-b5c2-a85fec01188c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:00.167191 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd017c46-15bc-4386-b5c2-a85fec01188c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:00.167980 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd017c46-15bc-4386-b5c2-a85fec01188c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:00.168419 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd017c46-15bc-4386-b5c2-a85fec01188c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:00.293879 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dd017c46-15bc-4386-b5c2-a85fec01188c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:00.301129 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dd017c46-15bc-4386-b5c2-a85fec01188c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.146929 May 27 09:42:00.301712 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 208/433] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:00 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:00.452034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5f3dd200-a4d7-46b4-b617-e24cfbb6d858 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:00.453286 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5f3dd200-a4d7-46b4-b617-e24cfbb6d858 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:00.459804 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5f3dd200-a4d7-46b4-b617-e24cfbb6d858 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:00.460262 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5f3dd200-a4d7-46b4-b617-e24cfbb6d858 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:00.461028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5f3dd200-a4d7-46b4-b617-e24cfbb6d858 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:00.461469 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5f3dd200-a4d7-46b4-b617-e24cfbb6d858 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:00.607242 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5f3dd200-a4d7-46b4-b617-e24cfbb6d858 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:00.614739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5f3dd200-a4d7-46b4-b617-e24cfbb6d858 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.166643 May 27 09:42:00.615328 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 226/434] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:00 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:00.894086 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f3b13eb4-b924-426e-a64e-02c732a31ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:00.894692 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f3b13eb4-b924-426e-a64e-02c732a31ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:00.907027 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3b13eb4-b924-426e-a64e-02c732a31ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:00.907531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3b13eb4-b924-426e-a64e-02c732a31ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:00.908318 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3b13eb4-b924-426e-a64e-02c732a31ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:00.908746 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3b13eb4-b924-426e-a64e-02c732a31ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:01.059842 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f3b13eb4-b924-426e-a64e-02c732a31ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:01.067607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f3b13eb4-b924-426e-a64e-02c732a31ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.177666 May 27 09:42:01.068212 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 209/435] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:00 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:01.317404 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7a3485c4-f1b9-4d0d-a64b-48017326a981 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:01.318012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7a3485c4-f1b9-4d0d-a64b-48017326a981 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:01.323965 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a3485c4-f1b9-4d0d-a64b-48017326a981 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:01.324411 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a3485c4-f1b9-4d0d-a64b-48017326a981 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:01.325174 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a3485c4-f1b9-4d0d-a64b-48017326a981 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:01.325608 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a3485c4-f1b9-4d0d-a64b-48017326a981 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:01.517688 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7a3485c4-f1b9-4d0d-a64b-48017326a981 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:01.525346 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7a3485c4-f1b9-4d0d-a64b-48017326a981 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.211874 May 27 09:42:01.525909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 227/436] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:01 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:01.631646 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-36613a5a-d47e-410a-9762-87ecdff23510 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:01.632259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-36613a5a-d47e-410a-9762-87ecdff23510 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:01.638591 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-36613a5a-d47e-410a-9762-87ecdff23510 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:01.639039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-36613a5a-d47e-410a-9762-87ecdff23510 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:01.639849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-36613a5a-d47e-410a-9762-87ecdff23510 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:01.640285 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-36613a5a-d47e-410a-9762-87ecdff23510 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:01.878484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-36613a5a-d47e-410a-9762-87ecdff23510 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:01.886609 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-36613a5a-d47e-410a-9762-87ecdff23510 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.258717 May 27 09:42:01.887266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 210/437] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:01 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:02.084387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a91e08bf-1bb8-4704-b830-d660b62e6c1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:02.084991 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a91e08bf-1bb8-4704-b830-d660b62e6c1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:02.091332 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a91e08bf-1bb8-4704-b830-d660b62e6c1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:02.091785 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a91e08bf-1bb8-4704-b830-d660b62e6c1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:02.092552 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a91e08bf-1bb8-4704-b830-d660b62e6c1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:02.092986 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a91e08bf-1bb8-4704-b830-d660b62e6c1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:02.208972 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-8573ef3c-b5ed-45ff-b224-ea51592c38b7 req-5f08ab59-947d-41b0-88a3-233cdcf563c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd942627-ce67-4a65-95dc-a589397bd130", "name": "network-vif-plugged", "status": "completed", "tag": "7adfbb2e-f976-47e6-8ad5-c96c45292acc"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:02.236777 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a91e08bf-1bb8-4704-b830-d660b62e6c1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:02.239502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=100 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:02.242780 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-8573ef3c-b5ed-45ff-b224-ea51592c38b7 req-5f08ab59-947d-41b0-88a3-233cdcf563c6 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:02.244130 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-8573ef3c-b5ed-45ff-b224-ea51592c38b7 req-5f08ab59-947d-41b0-88a3-233cdcf563c6 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:02.247390 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a91e08bf-1bb8-4704-b830-d660b62e6c1b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.166722 May 27 09:42:02.248477 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 228/438] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:02 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:02.259573 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-8573ef3c-b5ed-45ff-b224-ea51592c38b7 req-5f08ab59-947d-41b0-88a3-233cdcf563c6 service nova] Creating event network-vif-plugged:7adfbb2e-f976-47e6-8ad5-c96c45292acc for instance cd942627-ce67-4a65-95dc-a589397bd130 on hv-cinder-79760 May 27 09:42:02.266672 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-8573ef3c-b5ed-45ff-b224-ea51592c38b7 req-5f08ab59-947d-41b0-88a3-233cdcf563c6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061401 May 27 09:42:02.267723 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 211/439] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:02.542485 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ed8e4a6f-600d-4a81-9697-920e8fcfb262 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:02.543096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ed8e4a6f-600d-4a81-9697-920e8fcfb262 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:02.549978 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ed8e4a6f-600d-4a81-9697-920e8fcfb262 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:02.550424 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ed8e4a6f-600d-4a81-9697-920e8fcfb262 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:02.551183 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ed8e4a6f-600d-4a81-9697-920e8fcfb262 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:02.551641 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ed8e4a6f-600d-4a81-9697-920e8fcfb262 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:02.690177 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ed8e4a6f-600d-4a81-9697-920e8fcfb262 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:02.697933 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ed8e4a6f-600d-4a81-9697-920e8fcfb262 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.159230 May 27 09:42:02.698723 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 229/440] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:02 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:02.904889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-35fb75ba-ce9d-4859-9ba5-dbe997533867 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:02.905587 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-35fb75ba-ce9d-4859-9ba5-dbe997533867 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:02.913032 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35fb75ba-ce9d-4859-9ba5-dbe997533867 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:02.913418 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35fb75ba-ce9d-4859-9ba5-dbe997533867 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:02.914178 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35fb75ba-ce9d-4859-9ba5-dbe997533867 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:02.914721 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35fb75ba-ce9d-4859-9ba5-dbe997533867 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:03.052532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-35fb75ba-ce9d-4859-9ba5-dbe997533867 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:03.059946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-35fb75ba-ce9d-4859-9ba5-dbe997533867 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.159258 May 27 09:42:03.060708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 212/441] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:02 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:03.265168 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f7caf9d9-8ff7-4bf7-9dad-7697795bea68 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:03.265774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f7caf9d9-8ff7-4bf7-9dad-7697795bea68 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:03.271698 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f7caf9d9-8ff7-4bf7-9dad-7697795bea68 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:03.272149 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f7caf9d9-8ff7-4bf7-9dad-7697795bea68 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:03.272906 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f7caf9d9-8ff7-4bf7-9dad-7697795bea68 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:03.273518 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f7caf9d9-8ff7-4bf7-9dad-7697795bea68 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:03.409284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f7caf9d9-8ff7-4bf7-9dad-7697795bea68 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:03.417800 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f7caf9d9-8ff7-4bf7-9dad-7697795bea68 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.156191 May 27 09:42:03.419017 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 230/442] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:03 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:03.714443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ccd50c14-6f22-4ba6-8cb5-6ef3854a1b62 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:03.715252 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ccd50c14-6f22-4ba6-8cb5-6ef3854a1b62 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:03.722834 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ccd50c14-6f22-4ba6-8cb5-6ef3854a1b62 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:03.723307 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ccd50c14-6f22-4ba6-8cb5-6ef3854a1b62 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:03.724088 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ccd50c14-6f22-4ba6-8cb5-6ef3854a1b62 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:03.724525 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ccd50c14-6f22-4ba6-8cb5-6ef3854a1b62 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:03.901790 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ccd50c14-6f22-4ba6-8cb5-6ef3854a1b62 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:03.920112 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ccd50c14-6f22-4ba6-8cb5-6ef3854a1b62 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.206269 May 27 09:42:03.934538 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 213/443] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:03 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:04.077958 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2892dacb-a9b9-4d7a-a345-a8c62b0bbdf3 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:04.078595 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2892dacb-a9b9-4d7a-a345-a8c62b0bbdf3 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:04.085839 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2892dacb-a9b9-4d7a-a345-a8c62b0bbdf3 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:04.086702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2892dacb-a9b9-4d7a-a345-a8c62b0bbdf3 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:04.087649 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2892dacb-a9b9-4d7a-a345-a8c62b0bbdf3 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:04.088280 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2892dacb-a9b9-4d7a-a345-a8c62b0bbdf3 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:04.376585 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2892dacb-a9b9-4d7a-a345-a8c62b0bbdf3 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:04.385151 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2892dacb-a9b9-4d7a-a345-a8c62b0bbdf3 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1505 microversion: 2.1 time: 0.310141 May 27 09:42:04.385151 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 231/444] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:04 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:04.436271 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-39e6ab78-c613-4bb3-a55a-931a0810feeb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:04.437134 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-39e6ab78-c613-4bb3-a55a-931a0810feeb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:04.444218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39e6ab78-c613-4bb3-a55a-931a0810feeb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:04.444662 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39e6ab78-c613-4bb3-a55a-931a0810feeb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:04.445679 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39e6ab78-c613-4bb3-a55a-931a0810feeb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:04.446113 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39e6ab78-c613-4bb3-a55a-931a0810feeb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:04.751827 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-39e6ab78-c613-4bb3-a55a-931a0810feeb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:04.769948 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-39e6ab78-c613-4bb3-a55a-931a0810feeb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1510 microversion: 2.1 time: 0.337756 May 27 09:42:04.770702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-2b4e337d-81d3-47b6-b3a9-9e09542cab17 req-30c5a5c8-d45c-4e5d-93b6-c6126ce6f9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d819828-35b1-4ba8-8309-4e66ec7ccf27", "name": "network-vif-deleted", "tag": "29e0e6fe-fdf8-4aef-8d63-c82097856df5"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:04.774186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 214/445] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:04 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:04.779935 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-2b4e337d-81d3-47b6-b3a9-9e09542cab17 req-30c5a5c8-d45c-4e5d-93b6-c6126ce6f9ad service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:04.780462 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-2b4e337d-81d3-47b6-b3a9-9e09542cab17 req-30c5a5c8-d45c-4e5d-93b6-c6126ce6f9ad service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:04.791729 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-2b4e337d-81d3-47b6-b3a9-9e09542cab17 req-30c5a5c8-d45c-4e5d-93b6-c6126ce6f9ad service nova] Creating event network-vif-deleted:29e0e6fe-fdf8-4aef-8d63-c82097856df5 for instance 8d819828-35b1-4ba8-8309-4e66ec7ccf27 on hv-cinder-79760 May 27 09:42:04.796562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-2b4e337d-81d3-47b6-b3a9-9e09542cab17 req-30c5a5c8-d45c-4e5d-93b6-c6126ce6f9ad service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031617 May 27 09:42:04.797828 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 232/446] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:42:04.943250 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b778708d-e62a-4a8c-8c48-6fb7b5ca4793 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:04.943888 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b778708d-e62a-4a8c-8c48-6fb7b5ca4793 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:04.950294 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b778708d-e62a-4a8c-8c48-6fb7b5ca4793 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:04.950745 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b778708d-e62a-4a8c-8c48-6fb7b5ca4793 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:04.951605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b778708d-e62a-4a8c-8c48-6fb7b5ca4793 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:04.952049 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b778708d-e62a-4a8c-8c48-6fb7b5ca4793 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:05.095109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b778708d-e62a-4a8c-8c48-6fb7b5ca4793 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:05.103859 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b778708d-e62a-4a8c-8c48-6fb7b5ca4793 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.164235 May 27 09:42:05.104543 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 215/447] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:04 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:05.402410 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:05.403171 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:05.410038 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:05.410481 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:05.411230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:05.411689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:05.440562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:05.441002 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:05.441440 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lazy-loading 'fault' on Instance uuid 8d819828-35b1-4ba8-8309-4e66ec7ccf27 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:05.485133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:05.492343 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2d6a3a3e-5458-49e0-8513-f6abb6bf02be tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1304 microversion: 2.1 time: 0.094996 May 27 09:42:05.492896 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 233/448] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:05 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:05.790091 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-05cc55c1-cee0-4f49-bbd2-71374eea0eb7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:05.790708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-05cc55c1-cee0-4f49-bbd2-71374eea0eb7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:05.796773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-05cc55c1-cee0-4f49-bbd2-71374eea0eb7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:05.797225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-05cc55c1-cee0-4f49-bbd2-71374eea0eb7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:05.797994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-05cc55c1-cee0-4f49-bbd2-71374eea0eb7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:05.799134 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-05cc55c1-cee0-4f49-bbd2-71374eea0eb7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:05.931345 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-05cc55c1-cee0-4f49-bbd2-71374eea0eb7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:05.940273 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-05cc55c1-cee0-4f49-bbd2-71374eea0eb7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1516 microversion: 2.1 time: 0.154124 May 27 09:42:05.940880 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 216/449] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:05 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:06.121258 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-cfe13981-f9e2-48d5-a1f1-3b866e531387 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:06.121991 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-cfe13981-f9e2-48d5-a1f1-3b866e531387 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:06.128683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cfe13981-f9e2-48d5-a1f1-3b866e531387 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:06.129139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cfe13981-f9e2-48d5-a1f1-3b866e531387 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:06.129906 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cfe13981-f9e2-48d5-a1f1-3b866e531387 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:06.130348 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cfe13981-f9e2-48d5-a1f1-3b866e531387 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:06.308818 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cfe13981-f9e2-48d5-a1f1-3b866e531387 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:06.316914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-cfe13981-f9e2-48d5-a1f1-3b866e531387 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.199480 May 27 09:42:06.317421 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 234/450] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:06 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:06.509702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:06.510313 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:06.517618 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:06.518082 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:06.518842 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:06.519364 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:06.550731 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:06.551170 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:06.551636 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lazy-loading 'fault' on Instance uuid 8d819828-35b1-4ba8-8309-4e66ec7ccf27 {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:06.596871 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:06.604717 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1c7bb17c-f9ce-4a50-b48e-c2174372219f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1304 microversion: 2.1 time: 0.098862 May 27 09:42:06.605286 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 217/451] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:06 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:07.291579 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8d1b55c7-e2b5-4931-9259-f6972191b6f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'create', calling method: .version_select at 0x7f188c3653a0>, body: {"keypair": {"name": "tempest-keypair-1532097097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa4OA6L6eD5PMzXJLw6UHGK2tDrlb54vv+beTD8GSRDoUw5Wocq1DwYvEbNDDKN1QPym6zV91km6Q0+2QxqbFgPyOzpUmOMRLH5qKj2xudfA6keSoBr3saJhQV9aH6rKw=="}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:07.309522 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-8d1b55c7-e2b5-4931-9259-f6972191b6f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Getting quotas for project 0cad683f27d14cf5a90a19525a467a52. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:42:07.314843 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-8d1b55c7-e2b5-4931-9259-f6972191b6f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Getting quotas for user 1331ba69eaec44dd9bd8f8db7d53ba5c and project 0cad683f27d14cf5a90a19525a467a52. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:42:07.334545 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3fac67dd-9fde-4b69-bc08-415f779c3a36 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:07.335742 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-3fac67dd-9fde-4b69-bc08-415f779c3a36 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:07.347495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3fac67dd-9fde-4b69-bc08-415f779c3a36 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:07.350840 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3fac67dd-9fde-4b69-bc08-415f779c3a36 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:07.352532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3fac67dd-9fde-4b69-bc08-415f779c3a36 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:07.353384 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3fac67dd-9fde-4b69-bc08-415f779c3a36 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:07.372658 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8d1b55c7-e2b5-4931-9259-f6972191b6f6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.085005 May 27 09:42:07.375836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 235/452] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 09:42:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:07.540707 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-3fac67dd-9fde-4b69-bc08-415f779c3a36 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:07.549419 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3fac67dd-9fde-4b69-bc08-415f779c3a36 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1359 microversion: 2.1 time: 0.218755 May 27 09:42:07.550206 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 218/453] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:07 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:07.622193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:07.622910 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:07.629661 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:07.630115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:07.630921 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:07.631381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:07.666028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:07.666487 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:07.666933 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lazy-loading 'fault' on Instance uuid 8d819828-35b1-4ba8-8309-4e66ec7ccf27 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:07.711102 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:07.718463 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c031df5d-2934-4b7a-b258-00935b913e2f tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1304 microversion: 2.1 time: 0.100329 May 27 09:42:07.719026 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 236/454] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:07 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:08.566954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-df37a444-6f15-48da-a6bc-9df217519209 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:08.567989 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-df37a444-6f15-48da-a6bc-9df217519209 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:08.574295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df37a444-6f15-48da-a6bc-9df217519209 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:08.574740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df37a444-6f15-48da-a6bc-9df217519209 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:08.575531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df37a444-6f15-48da-a6bc-9df217519209 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:08.575966 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df37a444-6f15-48da-a6bc-9df217519209 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:08.684846 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-187185085", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b6e2b01-d1c7-4bef-b4c4-509cdfcf99eb"}], "security_groups": [{"name": "tempest-securitygroup--1108605833"}], "key_name": "tempest-keypair-1532097097", "user_data": "}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:08.706799 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-df37a444-6f15-48da-a6bc-9df217519209 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:08.714316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-df37a444-6f15-48da-a6bc-9df217519209 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1550 microversion: 2.1 time: 0.152256 May 27 09:42:08.714964 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 219/455] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:08 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1550 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:08.731809 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-50fec4a8-fffc-4750-8c4b-365aae561260 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:08.736319 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-50fec4a8-fffc-4750-8c4b-365aae561260 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:08.742409 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-50fec4a8-fffc-4750-8c4b-365aae561260 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:08.742858 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-50fec4a8-fffc-4750-8c4b-365aae561260 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:08.743689 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-50fec4a8-fffc-4750-8c4b-365aae561260 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:08.744123 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-50fec4a8-fffc-4750-8c4b-365aae561260 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:08.799654 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] validate_networks() for [('7b6e2b01-d1c7-4bef-b4c4-509cdfcf99eb', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:42:08.957010 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-50fec4a8-fffc-4750-8c4b-365aae561260 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:08.964510 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-50fec4a8-fffc-4750-8c4b-365aae561260 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1550 microversion: 2.1 time: 0.236742 May 27 09:42:08.965077 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 220/456] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:08 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1550 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:08.971397 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:08.972067 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:08.978026 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:08.978477 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:08.979258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:08.979722 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:09.010088 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:09.010538 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:09.010981 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lazy-loading 'fault' on Instance uuid 8d819828-35b1-4ba8-8309-4e66ec7ccf27 {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:09.070132 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:09.077922 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-678207ee-699c-4ad8-913e-c86bb5ddcc34 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1304 microversion: 2.1 time: 0.110934 May 27 09:42:09.078575 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 221/457] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:08 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:09.090350 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a009d8cc-a631-4060-b215-1567d8ae8d6c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:09.094180 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a009d8cc-a631-4060-b215-1567d8ae8d6c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:09.096337 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a009d8cc-a631-4060-b215-1567d8ae8d6c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Searching by: {'deleted': False, 'project_id': '050fc8655bd34646b1b3f211b6fd912a'} {{(pid=129291) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 09:42:09.103684 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a009d8cc-a631-4060-b215-1567d8ae8d6c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:09.103993 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a009d8cc-a631-4060-b215-1567d8ae8d6c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:09.104803 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a009d8cc-a631-4060-b215-1567d8ae8d6c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:09.105241 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a009d8cc-a631-4060-b215-1567d8ae8d6c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:09.195726 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.multi_cell_list [None req-a009d8cc-a631-4060-b215-1567d8ae8d6c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129291) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 09:42:09.250765 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:42:09.251729 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:42:09.252207 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:42:09.252639 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:42:09.253047 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:42:09.261676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:09.262117 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:09.262912 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:09.263375 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:09.280082 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Getting quotas for project 0cad683f27d14cf5a90a19525a467a52. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:42:09.284081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Getting quotas for user 1331ba69eaec44dd9bd8f8db7d53ba5c and project 0cad683f27d14cf5a90a19525a467a52. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:42:09.293148 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a009d8cc-a631-4060-b215-1567d8ae8d6c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213495 May 27 09:42:09.293744 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 222/458] 10.222.0.41 () {58 vars in 1124 bytes} [Fri May 27 09:42:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:09.294839 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:42:09.297134 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:42:09.304572 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6718ea10-c44f-4ca4-b097-107f9e7099b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:09.305225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6718ea10-c44f-4ca4-b097-107f9e7099b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:09.311389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6718ea10-c44f-4ca4-b097-107f9e7099b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:09.311839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6718ea10-c44f-4ca4-b097-107f9e7099b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:09.312602 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6718ea10-c44f-4ca4-b097-107f9e7099b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:09.313036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6718ea10-c44f-4ca4-b097-107f9e7099b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:09.343463 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4657afc2-8294-4baa-b251-be14f8cb6987 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.662758 May 27 09:42:09.344017 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 237/459] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:42:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 09:42:09.353727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2b5134a1-3aa2-4273-a6ee-c54947e393ad tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:09.354337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2b5134a1-3aa2-4273-a6ee-c54947e393ad tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:09.411109 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2b5134a1-3aa2-4273-a6ee-c54947e393ad tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:09.417731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2b5134a1-3aa2-4273-a6ee-c54947e393ad tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1245 microversion: 2.1 time: 0.067623 May 27 09:42:09.418509 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 238/460] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:09 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:09.482263 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6718ea10-c44f-4ca4-b097-107f9e7099b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:09.489732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6718ea10-c44f-4ca4-b097-107f9e7099b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1550 microversion: 2.1 time: 0.189372 May 27 09:42:09.490302 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 223/461] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:09 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1550 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:10.096010 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:10.096623 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:10.103015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:10.103570 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:10.104326 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:10.104756 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:10.137048 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:10.137488 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:10.137924 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lazy-loading 'fault' on Instance uuid 8d819828-35b1-4ba8-8309-4e66ec7ccf27 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:10.186818 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:10.194292 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f2f1fe41-0cdd-4307-969e-49132d58470e tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1304 microversion: 2.1 time: 0.102865 May 27 09:42:10.194850 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 239/462] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:10 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:10.434030 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9d3cc8ca-5b09-4fd0-b6d1-6d2ef1e1dfd7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:10.434592 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9d3cc8ca-5b09-4fd0-b6d1-6d2ef1e1dfd7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:10.441114 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9d3cc8ca-5b09-4fd0-b6d1-6d2ef1e1dfd7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:10.441560 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9d3cc8ca-5b09-4fd0-b6d1-6d2ef1e1dfd7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:10.442319 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9d3cc8ca-5b09-4fd0-b6d1-6d2ef1e1dfd7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:10.442753 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9d3cc8ca-5b09-4fd0-b6d1-6d2ef1e1dfd7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:10.446663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=100 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:10.528010 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9d3cc8ca-5b09-4fd0-b6d1-6d2ef1e1dfd7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:10.535620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9d3cc8ca-5b09-4fd0-b6d1-6d2ef1e1dfd7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1249 microversion: 2.1 time: 0.105602 May 27 09:42:10.536189 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 224/463] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:10 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1249 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:11.210961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:11.211591 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:11.218055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:11.218498 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:11.219253 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:11.219703 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:11.249374 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:11.249808 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:11.250243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lazy-loading 'fault' on Instance uuid 8d819828-35b1-4ba8-8309-4e66ec7ccf27 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:11.290116 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:11.297556 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-af7af550-e1e8-47f1-9a36-ab09eea826e0 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1304 microversion: 2.1 time: 0.090351 May 27 09:42:11.298124 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 240/464] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:11 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:11.552069 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e1aec060-604b-4819-a6df-096285a18b24 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:11.552683 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e1aec060-604b-4819-a6df-096285a18b24 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:11.559140 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e1aec060-604b-4819-a6df-096285a18b24 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:11.559627 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e1aec060-604b-4819-a6df-096285a18b24 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:11.560390 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e1aec060-604b-4819-a6df-096285a18b24 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:11.560829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e1aec060-604b-4819-a6df-096285a18b24 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:11.623544 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e1aec060-604b-4819-a6df-096285a18b24 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:11.630912 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e1aec060-604b-4819-a6df-096285a18b24 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1249 microversion: 2.1 time: 0.082623 May 27 09:42:11.631508 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 225/465] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:11 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:12.318297 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:12.318913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:12.325334 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:12.325783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:12.326550 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:12.326968 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:12.361864 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:12.362312 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:12.362759 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lazy-loading 'fault' on Instance uuid 8d819828-35b1-4ba8-8309-4e66ec7ccf27 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:12.409615 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35535c6b1c74a0baf58c8ccdbf30772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b17fac30e6a469a8e0ca8b6e2fcdc1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:12.417808 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bab6b2ec-c524-42c5-9952-59a9dce08755 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 200 len: 1304 microversion: 2.1 time: 0.103819 May 27 09:42:12.418315 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 241/466] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:12 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:12.647979 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7fa05805-0821-4df8-877d-c6b24e078d89 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:12.649149 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7fa05805-0821-4df8-877d-c6b24e078d89 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:12.655835 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fa05805-0821-4df8-877d-c6b24e078d89 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:12.656317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fa05805-0821-4df8-877d-c6b24e078d89 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:12.657120 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fa05805-0821-4df8-877d-c6b24e078d89 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:12.658102 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fa05805-0821-4df8-877d-c6b24e078d89 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:12.737831 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7fa05805-0821-4df8-877d-c6b24e078d89 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:12.746188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7fa05805-0821-4df8-877d-c6b24e078d89 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1297 microversion: 2.1 time: 0.102041 May 27 09:42:12.746833 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 226/467] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:12 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:13.434233 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-18444110-747e-49f7-919a-50df15ec0280 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:13.435083 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-18444110-747e-49f7-919a-50df15ec0280 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] [instance: 8d819828-35b1-4ba8-8309-4e66ec7ccf27] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:13.441627 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18444110-747e-49f7-919a-50df15ec0280 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:13.442072 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18444110-747e-49f7-919a-50df15ec0280 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:13.442829 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18444110-747e-49f7-919a-50df15ec0280 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:13.443258 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18444110-747e-49f7-919a-50df15ec0280 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:13.456962 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-18444110-747e-49f7-919a-50df15ec0280 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] HTTP exception thrown: Instance 8d819828-35b1-4ba8-8309-4e66ec7ccf27 could not be found. May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-18444110-747e-49f7-919a-50df15ec0280 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Request method failure captured: May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 HTTP/1.1 May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJxwETt1bS8CxCt_r5fNw6KJFRpwoKu8Wr7l9dujKWS43ZHMsO5qBjP_vyldND_iIwtjddsMi1rCqd8QmkDnvB1jpie-L9CsvTTAPMvrL9dQynlFh_BIC64VSmRSqoGZGR9SmB_ZMKpnoX5JI1Kj3YcBYpKsJjp4OpLgbZyuSYpLYhU May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 4b17fac30e6a469a8e0ca8b6e2fcdc1d May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-VolumesActionsTest-2102171732 May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:42:13.459012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/4b17fac30e6a469a8e0ca8b6e2fcdc1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4b17fac30e6a469a8e0ca8b6e2fcdc1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4b17fac30e6a469a8e0ca8b6e2fcdc1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_4b17fac30e6a469a8e0ca8b6e2fcdc1d"}]}] May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-VolumesActionsTest-2102171732 May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 4b17fac30e6a469a8e0ca8b6e2fcdc1d May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-VolumesActionsTest-2102171732 May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-VolumesActionsTest-2102171732-project May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: b35535c6b1c74a0baf58c8ccdbf30772 May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-VolumesActionsTest-2102171732-project May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 8d819828-35b1-4ba8-8309-4e66ec7ccf27 could not be found. May 27 09:42:13.460648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '8d819828-35b1-4ba8-8309-4e66ec7ccf27'} May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d819828-35b1-4ba8-8309-4e66ec7ccf27 could not be found. May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:42:13.461396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d819828-35b1-4ba8-8309-4e66ec7ccf27 could not be found. May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d819828-35b1-4ba8-8309-4e66ec7ccf27 could not be found. May 27 09:42:13.462730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:42:13.463796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-18444110-747e-49f7-919a-50df15ec0280 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] Returning 404 to user: Instance 8d819828-35b1-4ba8-8309-4e66ec7ccf27 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:42:13.463796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-18444110-747e-49f7-919a-50df15ec0280 tempest-VolumesActionsTest-2102171732 tempest-VolumesActionsTest-2102171732-project] 10.222.0.41 "GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27" status: 404 len: 111 microversion: 2.1 time: 0.030165 May 27 09:42:13.463796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 242/468] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:13 2022] GET /compute/v2.1/servers/8d819828-35b1-4ba8-8309-4e66ec7ccf27 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:42:13.769877 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dff8de2a-919f-4e08-af4f-e0176d475cbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:13.770487 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dff8de2a-919f-4e08-af4f-e0176d475cbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:13.778335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dff8de2a-919f-4e08-af4f-e0176d475cbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:13.778783 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dff8de2a-919f-4e08-af4f-e0176d475cbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:13.780941 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dff8de2a-919f-4e08-af4f-e0176d475cbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:13.781430 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dff8de2a-919f-4e08-af4f-e0176d475cbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:13.882995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dff8de2a-919f-4e08-af4f-e0176d475cbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:13.894096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dff8de2a-919f-4e08-af4f-e0176d475cbf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1303 microversion: 2.1 time: 0.126274 May 27 09:42:13.898982 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 227/469] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:13 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:14.231377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7a2aec5c-ab5f-46d0-9185-b1ec42fb0a05 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fab9bddd-6996-4e07-8d48-31b384400539"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:14.232535 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7a2aec5c-ab5f-46d0-9185-b1ec42fb0a05 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:14.241891 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a2aec5c-ab5f-46d0-9185-b1ec42fb0a05 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:14.242406 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a2aec5c-ab5f-46d0-9185-b1ec42fb0a05 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:14.244197 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a2aec5c-ab5f-46d0-9185-b1ec42fb0a05 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:14.244648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7a2aec5c-ab5f-46d0-9185-b1ec42fb0a05 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:14.911629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8f9e2811-f0aa-4d51-b0a8-c25cf083ce21 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:14.912494 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8f9e2811-f0aa-4d51-b0a8-c25cf083ce21 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:14.919216 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f9e2811-f0aa-4d51-b0a8-c25cf083ce21 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:14.919688 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f9e2811-f0aa-4d51-b0a8-c25cf083ce21 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:14.920453 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f9e2811-f0aa-4d51-b0a8-c25cf083ce21 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:14.920888 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f9e2811-f0aa-4d51-b0a8-c25cf083ce21 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:15.055197 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8f9e2811-f0aa-4d51-b0a8-c25cf083ce21 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:15.064365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8f9e2811-f0aa-4d51-b0a8-c25cf083ce21 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.156046 May 27 09:42:15.065062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 228/470] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:14 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:16.081901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-bae7612c-6ffb-478c-ac2b-e37020de541a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:16.082519 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bae7612c-6ffb-478c-ac2b-e37020de541a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:16.090769 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bae7612c-6ffb-478c-ac2b-e37020de541a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:16.091341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bae7612c-6ffb-478c-ac2b-e37020de541a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:16.092193 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bae7612c-6ffb-478c-ac2b-e37020de541a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:16.092807 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bae7612c-6ffb-478c-ac2b-e37020de541a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:16.304495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bae7612c-6ffb-478c-ac2b-e37020de541a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:16.315158 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-bae7612c-6ffb-478c-ac2b-e37020de541a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.237606 May 27 09:42:16.315819 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 229/471] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:16 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:16.320424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-64161389-7bbd-470e-9c41-5daa63397d33 req-4a24ef14-6e85-4cfe-b041-6dc47379b4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4572f19b-c60d-461e-8eec-9c9f8a25201c", "tag": "be291203-ca93-4891-adc1-934c52d11bd3"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:16.328856 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-64161389-7bbd-470e-9c41-5daa63397d33 req-4a24ef14-6e85-4cfe-b041-6dc47379b4d4 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:16.329336 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-64161389-7bbd-470e-9c41-5daa63397d33 req-4a24ef14-6e85-4cfe-b041-6dc47379b4d4 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:16.340393 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-64161389-7bbd-470e-9c41-5daa63397d33 req-4a24ef14-6e85-4cfe-b041-6dc47379b4d4 service nova] Creating event network-changed:be291203-ca93-4891-adc1-934c52d11bd3 for instance 4572f19b-c60d-461e-8eec-9c9f8a25201c on hv-cinder-79760 May 27 09:42:16.346368 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-64161389-7bbd-470e-9c41-5daa63397d33 req-4a24ef14-6e85-4cfe-b041-6dc47379b4d4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028866 May 27 09:42:16.346975 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 230/472] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:17.333732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9e9ae1f6-a4fe-473f-a7b1-ff5f60b458ef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:17.334371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9e9ae1f6-a4fe-473f-a7b1-ff5f60b458ef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:17.340893 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1f6-a4fe-473f-a7b1-ff5f60b458ef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:17.341345 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1f6-a4fe-473f-a7b1-ff5f60b458ef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:17.342106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1f6-a4fe-473f-a7b1-ff5f60b458ef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:17.342545 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9e9ae1f6-a4fe-473f-a7b1-ff5f60b458ef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:17.480134 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9e9ae1f6-a4fe-473f-a7b1-ff5f60b458ef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:17.487392 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9e9ae1f6-a4fe-473f-a7b1-ff5f60b458ef tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.158962 May 27 09:42:17.487956 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 231/473] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:17 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:18.504155 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b0b0871a-6aed-476c-9ac1-340dd8e7a1bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:18.504759 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b0b0871a-6aed-476c-9ac1-340dd8e7a1bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:18.511186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b0b0871a-6aed-476c-9ac1-340dd8e7a1bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:18.511666 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b0b0871a-6aed-476c-9ac1-340dd8e7a1bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:18.512434 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b0b0871a-6aed-476c-9ac1-340dd8e7a1bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:18.512873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b0b0871a-6aed-476c-9ac1-340dd8e7a1bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:18.677126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b0b0871a-6aed-476c-9ac1-340dd8e7a1bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:18.685093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b0b0871a-6aed-476c-9ac1-340dd8e7a1bb tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.185096 May 27 09:42:18.685676 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 232/474] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:18 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:18.764574 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7a2aec5c-ab5f-46d0-9185-b1ec42fb0a05 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "POST /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.537308 May 27 09:42:18.765504 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 243/475] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:42:14 2022] POST /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments => generated 194 bytes in 4539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:19.701928 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5fb11561-9270-4686-a333-c2ef6bafe45b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:19.702546 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5fb11561-9270-4686-a333-c2ef6bafe45b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:19.705068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:19.706232 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:19.712064 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5fb11561-9270-4686-a333-c2ef6bafe45b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:19.712441 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5fb11561-9270-4686-a333-c2ef6bafe45b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:19.713729 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5fb11561-9270-4686-a333-c2ef6bafe45b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:19.713729 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5fb11561-9270-4686-a333-c2ef6bafe45b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:19.867193 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5fb11561-9270-4686-a333-c2ef6bafe45b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:19.875120 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5fb11561-9270-4686-a333-c2ef6bafe45b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.176939 May 27 09:42:19.875740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 233/476] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:19 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:20.893584 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c8f2606a-515e-456e-8d56-3524212d0641 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:20.894274 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c8f2606a-515e-456e-8d56-3524212d0641 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:20.896636 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:20.897314 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=12 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:20.903713 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c8f2606a-515e-456e-8d56-3524212d0641 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:20.904161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c8f2606a-515e-456e-8d56-3524212d0641 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:20.904922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c8f2606a-515e-456e-8d56-3524212d0641 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:20.905363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c8f2606a-515e-456e-8d56-3524212d0641 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:21.045244 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c8f2606a-515e-456e-8d56-3524212d0641 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:21.052569 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c8f2606a-515e-456e-8d56-3524212d0641 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.163746 May 27 09:42:21.053252 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 244/477] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:20 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:22.069798 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-295ab7be-8a59-452b-9863-6232f1ce0f0f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:22.070403 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-295ab7be-8a59-452b-9863-6232f1ce0f0f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:22.077158 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-295ab7be-8a59-452b-9863-6232f1ce0f0f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:22.077624 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-295ab7be-8a59-452b-9863-6232f1ce0f0f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:22.078381 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-295ab7be-8a59-452b-9863-6232f1ce0f0f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:22.078830 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-295ab7be-8a59-452b-9863-6232f1ce0f0f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:22.205595 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-295ab7be-8a59-452b-9863-6232f1ce0f0f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:22.212884 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-295ab7be-8a59-452b-9863-6232f1ce0f0f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.146822 May 27 09:42:22.213442 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 234/478] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:22 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:23.229608 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-98048ce0-63bf-4ef4-8430-93df73e3b9a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:23.230218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-98048ce0-63bf-4ef4-8430-93df73e3b9a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:23.236956 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-98048ce0-63bf-4ef4-8430-93df73e3b9a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:23.237412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-98048ce0-63bf-4ef4-8430-93df73e3b9a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:23.238200 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-98048ce0-63bf-4ef4-8430-93df73e3b9a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:23.238641 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-98048ce0-63bf-4ef4-8430-93df73e3b9a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:23.361888 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-98048ce0-63bf-4ef4-8430-93df73e3b9a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:23.369223 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-98048ce0-63bf-4ef4-8430-93df73e3b9a9 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.143472 May 27 09:42:23.369787 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 245/479] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:23 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:24.390328 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2855d117-154e-4b0d-8bf2-b5bea659a227 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:24.390923 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2855d117-154e-4b0d-8bf2-b5bea659a227 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:24.398081 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2855d117-154e-4b0d-8bf2-b5bea659a227 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:24.398530 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2855d117-154e-4b0d-8bf2-b5bea659a227 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:24.399343 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2855d117-154e-4b0d-8bf2-b5bea659a227 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:24.399779 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2855d117-154e-4b0d-8bf2-b5bea659a227 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:24.528345 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2855d117-154e-4b0d-8bf2-b5bea659a227 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:24.535870 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2855d117-154e-4b0d-8bf2-b5bea659a227 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.149373 May 27 09:42:24.536452 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 235/480] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:24 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:25.552242 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-dac8432c-f9ca-44da-9b77-9a960681e24a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:25.552877 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-dac8432c-f9ca-44da-9b77-9a960681e24a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:25.555347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:25.561256 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dac8432c-f9ca-44da-9b77-9a960681e24a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:25.561733 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dac8432c-f9ca-44da-9b77-9a960681e24a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:25.562485 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dac8432c-f9ca-44da-9b77-9a960681e24a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:25.562912 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dac8432c-f9ca-44da-9b77-9a960681e24a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:25.581566 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:25.701248 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-dac8432c-f9ca-44da-9b77-9a960681e24a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:25.709138 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-dac8432c-f9ca-44da-9b77-9a960681e24a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.160828 May 27 09:42:25.709711 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 246/481] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:25 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:26.726237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fc2d427a-7e34-4aaa-8555-26f61b937cd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:26.726854 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-fc2d427a-7e34-4aaa-8555-26f61b937cd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:26.733502 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc2d427a-7e34-4aaa-8555-26f61b937cd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:26.733956 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc2d427a-7e34-4aaa-8555-26f61b937cd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:26.734724 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc2d427a-7e34-4aaa-8555-26f61b937cd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:26.735166 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc2d427a-7e34-4aaa-8555-26f61b937cd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:26.864484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fc2d427a-7e34-4aaa-8555-26f61b937cd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:26.871959 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fc2d427a-7e34-4aaa-8555-26f61b937cd3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.149502 May 27 09:42:26.872527 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 236/482] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:26 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:27.889244 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a5865a7c-63ea-4d92-9f98-747335211ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:27.889908 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a5865a7c-63ea-4d92-9f98-747335211ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:27.896486 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a5865a7c-63ea-4d92-9f98-747335211ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:27.896878 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a5865a7c-63ea-4d92-9f98-747335211ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:27.897641 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a5865a7c-63ea-4d92-9f98-747335211ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:27.898072 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a5865a7c-63ea-4d92-9f98-747335211ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:28.025413 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a5865a7c-63ea-4d92-9f98-747335211ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:28.033258 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a5865a7c-63ea-4d92-9f98-747335211ad5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.147850 May 27 09:42:28.033826 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 247/483] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:27 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:29.049919 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a51080dc-c944-491b-9bf2-d4fffb88c417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:29.050565 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a51080dc-c944-491b-9bf2-d4fffb88c417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:29.057068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a51080dc-c944-491b-9bf2-d4fffb88c417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:29.057512 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a51080dc-c944-491b-9bf2-d4fffb88c417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:29.058273 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a51080dc-c944-491b-9bf2-d4fffb88c417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:29.058713 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a51080dc-c944-491b-9bf2-d4fffb88c417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:29.182158 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a51080dc-c944-491b-9bf2-d4fffb88c417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:29.190046 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a51080dc-c944-491b-9bf2-d4fffb88c417 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.144138 May 27 09:42:29.190612 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 237/484] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:29 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:30.206483 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-924ac5a7-4eb4-4e7c-93b9-d6b07b33e287 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:30.207112 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-924ac5a7-4eb4-4e7c-93b9-d6b07b33e287 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:30.213524 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-924ac5a7-4eb4-4e7c-93b9-d6b07b33e287 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:30.213963 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-924ac5a7-4eb4-4e7c-93b9-d6b07b33e287 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:30.214740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-924ac5a7-4eb4-4e7c-93b9-d6b07b33e287 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:30.215166 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-924ac5a7-4eb4-4e7c-93b9-d6b07b33e287 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:30.347338 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-924ac5a7-4eb4-4e7c-93b9-d6b07b33e287 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:30.356337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-924ac5a7-4eb4-4e7c-93b9-d6b07b33e287 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.152537 May 27 09:42:30.356337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 248/485] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:30 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:31.377259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cb66af58-ac45-455f-bf27-0abbef7c50ce tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:31.377865 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cb66af58-ac45-455f-bf27-0abbef7c50ce tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:31.384290 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb66af58-ac45-455f-bf27-0abbef7c50ce tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:31.384736 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb66af58-ac45-455f-bf27-0abbef7c50ce tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:31.385518 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb66af58-ac45-455f-bf27-0abbef7c50ce tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:31.385943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb66af58-ac45-455f-bf27-0abbef7c50ce tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:31.520833 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cb66af58-ac45-455f-bf27-0abbef7c50ce tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:31.528263 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cb66af58-ac45-455f-bf27-0abbef7c50ce tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.155527 May 27 09:42:31.528838 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 238/486] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:31 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:32.545254 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6036dbbe-ac54-49fe-84db-2c3207e3c011 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:32.545862 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6036dbbe-ac54-49fe-84db-2c3207e3c011 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:32.552917 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6036dbbe-ac54-49fe-84db-2c3207e3c011 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:32.553358 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6036dbbe-ac54-49fe-84db-2c3207e3c011 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:32.554112 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6036dbbe-ac54-49fe-84db-2c3207e3c011 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:32.554538 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6036dbbe-ac54-49fe-84db-2c3207e3c011 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:32.693058 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6036dbbe-ac54-49fe-84db-2c3207e3c011 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:32.700621 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6036dbbe-ac54-49fe-84db-2c3207e3c011 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.159187 May 27 09:42:32.701183 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 249/487] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:32 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:33.716679 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-75bef5be-7b47-4ecb-aebb-b0050acf9ea0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:33.717288 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-75bef5be-7b47-4ecb-aebb-b0050acf9ea0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:33.724055 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-75bef5be-7b47-4ecb-aebb-b0050acf9ea0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:33.724500 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-75bef5be-7b47-4ecb-aebb-b0050acf9ea0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:33.725262 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-75bef5be-7b47-4ecb-aebb-b0050acf9ea0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:33.725693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-75bef5be-7b47-4ecb-aebb-b0050acf9ea0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:33.856639 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-75bef5be-7b47-4ecb-aebb-b0050acf9ea0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:33.864656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-75bef5be-7b47-4ecb-aebb-b0050acf9ea0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.151752 May 27 09:42:33.865229 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 239/488] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:33 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:34.880603 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-46747e6c-eaf5-46f6-9ffd-305c87dab989 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:34.881202 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-46747e6c-eaf5-46f6-9ffd-305c87dab989 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:34.887633 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-46747e6c-eaf5-46f6-9ffd-305c87dab989 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:34.888075 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-46747e6c-eaf5-46f6-9ffd-305c87dab989 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:34.888817 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-46747e6c-eaf5-46f6-9ffd-305c87dab989 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:34.889240 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-46747e6c-eaf5-46f6-9ffd-305c87dab989 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:35.018027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-46747e6c-eaf5-46f6-9ffd-305c87dab989 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:35.025927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-46747e6c-eaf5-46f6-9ffd-305c87dab989 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.149596 May 27 09:42:35.026481 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 250/489] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:34 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:36.041724 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9ad285c1-c37c-43a1-b28f-309a0d41f859 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:36.042340 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9ad285c1-c37c-43a1-b28f-309a0d41f859 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:36.048776 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9ad285c1-c37c-43a1-b28f-309a0d41f859 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:36.049257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9ad285c1-c37c-43a1-b28f-309a0d41f859 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:36.050228 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9ad285c1-c37c-43a1-b28f-309a0d41f859 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:36.050665 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9ad285c1-c37c-43a1-b28f-309a0d41f859 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:36.174015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9ad285c1-c37c-43a1-b28f-309a0d41f859 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:36.182901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9ad285c1-c37c-43a1-b28f-309a0d41f859 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.144850 May 27 09:42:36.184008 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 240/490] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:36 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:37.201981 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d85ed8a0-fb0d-42d3-ab72-2142fe1c81e8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:37.202595 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d85ed8a0-fb0d-42d3-ab72-2142fe1c81e8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:37.209681 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d85ed8a0-fb0d-42d3-ab72-2142fe1c81e8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:37.210133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d85ed8a0-fb0d-42d3-ab72-2142fe1c81e8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:37.210895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d85ed8a0-fb0d-42d3-ab72-2142fe1c81e8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:37.211361 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d85ed8a0-fb0d-42d3-ab72-2142fe1c81e8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:37.334389 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d85ed8a0-fb0d-42d3-ab72-2142fe1c81e8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:37.342699 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d85ed8a0-fb0d-42d3-ab72-2142fe1c81e8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.144597 May 27 09:42:37.343269 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 251/491] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:37 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:38.362313 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6212fa6a-cb37-4eab-8523-e3f2cd50622c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:38.363433 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6212fa6a-cb37-4eab-8523-e3f2cd50622c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:38.369693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6212fa6a-cb37-4eab-8523-e3f2cd50622c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:38.370134 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6212fa6a-cb37-4eab-8523-e3f2cd50622c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:38.370889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6212fa6a-cb37-4eab-8523-e3f2cd50622c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:38.371355 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6212fa6a-cb37-4eab-8523-e3f2cd50622c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:38.388397 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=100 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:38.498928 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6212fa6a-cb37-4eab-8523-e3f2cd50622c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:38.507081 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6212fa6a-cb37-4eab-8523-e3f2cd50622c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.150044 May 27 09:42:38.507673 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 241/492] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:38 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:39.523776 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8328dde5-6011-4874-9fab-367b4c5813a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:39.524389 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8328dde5-6011-4874-9fab-367b4c5813a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:39.530806 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8328dde5-6011-4874-9fab-367b4c5813a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:39.531253 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8328dde5-6011-4874-9fab-367b4c5813a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:39.532052 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8328dde5-6011-4874-9fab-367b4c5813a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:39.532490 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8328dde5-6011-4874-9fab-367b4c5813a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:39.665188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8328dde5-6011-4874-9fab-367b4c5813a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:39.672609 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8328dde5-6011-4874-9fab-367b4c5813a7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.152635 May 27 09:42:39.673183 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 252/493] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:39 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:39.901547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2130455897", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:39.951136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.network.neutron [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] validate_networks() for None {{(pid=129291) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:42:40.229629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Flavor limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:42:40.230056 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Image limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:42:40.230532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Flavor pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:42:40.230945 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Image pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:42:40.231418 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:42:40.240229 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:40.240680 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:40.241502 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:40.241926 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:40.258996 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Getting quotas for project d51656e5a4ab48a98dad3b48f3b550d9. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:42:40.262932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Getting quotas for user b857644c1450464b8132b85271368aad and project d51656e5a4ab48a98dad3b48f3b550d9. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:42:40.274348 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Going to run 1 instances... {{(pid=129291) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:42:40.276584 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:42:40.322133 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-917df12a-129d-4f77-8397-7d7bcb663d92 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.424266 May 27 09:42:40.322719 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 242/494] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:42:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:42:40.333390 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-85e47383-9814-47e0-a592-97d9f1f159d6 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:40.334090 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-85e47383-9814-47e0-a592-97d9f1f159d6 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:40.387131 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-85e47383-9814-47e0-a592-97d9f1f159d6 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:40.393871 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-85e47383-9814-47e0-a592-97d9f1f159d6 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1215 microversion: 2.1 time: 0.065177 May 27 09:42:40.394445 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 253/495] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:40 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:40.689267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6796c1bd-16d6-4a2a-af6d-23c8ad0261ac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:40.689868 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6796c1bd-16d6-4a2a-af6d-23c8ad0261ac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:40.697062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6796c1bd-16d6-4a2a-af6d-23c8ad0261ac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:40.697511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6796c1bd-16d6-4a2a-af6d-23c8ad0261ac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:40.698267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6796c1bd-16d6-4a2a-af6d-23c8ad0261ac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:40.698700 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6796c1bd-16d6-4a2a-af6d-23c8ad0261ac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:40.826020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6796c1bd-16d6-4a2a-af6d-23c8ad0261ac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:40.833965 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6796c1bd-16d6-4a2a-af6d-23c8ad0261ac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.148574 May 27 09:42:40.834527 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 243/496] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:40 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:41.410361 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-388526f5-ad89-4675-8ca8-58b905aae321 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:41.410977 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-388526f5-ad89-4675-8ca8-58b905aae321 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:41.417923 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-388526f5-ad89-4675-8ca8-58b905aae321 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:41.418380 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-388526f5-ad89-4675-8ca8-58b905aae321 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:41.419158 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-388526f5-ad89-4675-8ca8-58b905aae321 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:41.419627 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-388526f5-ad89-4675-8ca8-58b905aae321 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:41.485186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-388526f5-ad89-4675-8ca8-58b905aae321 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:41.493651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-388526f5-ad89-4675-8ca8-58b905aae321 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1219 microversion: 2.1 time: 0.087085 May 27 09:42:41.494225 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 254/497] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:41 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:41.852399 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f0a71169-fadb-4496-bff3-e85fb60e6a27 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:41.853018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f0a71169-fadb-4496-bff3-e85fb60e6a27 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:41.859675 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f0a71169-fadb-4496-bff3-e85fb60e6a27 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:41.860131 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f0a71169-fadb-4496-bff3-e85fb60e6a27 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:41.860963 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f0a71169-fadb-4496-bff3-e85fb60e6a27 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:41.861329 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f0a71169-fadb-4496-bff3-e85fb60e6a27 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:41.986580 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f0a71169-fadb-4496-bff3-e85fb60e6a27 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:41.994041 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f0a71169-fadb-4496-bff3-e85fb60e6a27 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.145514 May 27 09:42:41.994609 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 244/498] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:41 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:42.509931 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-146ae44f-6f7d-4487-8583-f67cbba47eab tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:42.510537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-146ae44f-6f7d-4487-8583-f67cbba47eab tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:42.517057 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-146ae44f-6f7d-4487-8583-f67cbba47eab tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:42.517506 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-146ae44f-6f7d-4487-8583-f67cbba47eab tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:42.518895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-146ae44f-6f7d-4487-8583-f67cbba47eab tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:42.519356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-146ae44f-6f7d-4487-8583-f67cbba47eab tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:42.580136 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-146ae44f-6f7d-4487-8583-f67cbba47eab tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:42.587417 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-146ae44f-6f7d-4487-8583-f67cbba47eab tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1219 microversion: 2.1 time: 0.081339 May 27 09:42:42.587980 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 255/499] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:42 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:43.009606 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-888de6ca-c83d-4b81-8923-9647985ff852 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:43.010211 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-888de6ca-c83d-4b81-8923-9647985ff852 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:43.016585 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-888de6ca-c83d-4b81-8923-9647985ff852 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:43.017033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-888de6ca-c83d-4b81-8923-9647985ff852 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:43.017790 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-888de6ca-c83d-4b81-8923-9647985ff852 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:43.018227 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-888de6ca-c83d-4b81-8923-9647985ff852 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:43.144328 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-888de6ca-c83d-4b81-8923-9647985ff852 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:43.151620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-888de6ca-c83d-4b81-8923-9647985ff852 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.145716 May 27 09:42:43.152217 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 245/500] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:43 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:43.603691 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-345f4a31-bc87-4b4c-94c8-63f697434530 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:43.604300 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-345f4a31-bc87-4b4c-94c8-63f697434530 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:43.610663 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-345f4a31-bc87-4b4c-94c8-63f697434530 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:43.611107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-345f4a31-bc87-4b4c-94c8-63f697434530 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:43.612227 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-345f4a31-bc87-4b4c-94c8-63f697434530 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:43.612664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-345f4a31-bc87-4b4c-94c8-63f697434530 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:43.671123 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-345f4a31-bc87-4b4c-94c8-63f697434530 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:43.678335 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-345f4a31-bc87-4b4c-94c8-63f697434530 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1219 microversion: 2.1 time: 0.078463 May 27 09:42:43.678901 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 256/501] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:43 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:44.168884 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-89341d9c-47bc-4c2b-8595-81e816bcb25b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:44.169492 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-89341d9c-47bc-4c2b-8595-81e816bcb25b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:44.176579 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-89341d9c-47bc-4c2b-8595-81e816bcb25b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:44.177023 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-89341d9c-47bc-4c2b-8595-81e816bcb25b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:44.177787 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-89341d9c-47bc-4c2b-8595-81e816bcb25b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:44.178222 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-89341d9c-47bc-4c2b-8595-81e816bcb25b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:44.307872 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-89341d9c-47bc-4c2b-8595-81e816bcb25b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:44.315770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-89341d9c-47bc-4c2b-8595-81e816bcb25b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.150192 May 27 09:42:44.316332 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 246/502] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:44 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:44.694279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6a647f79-f15c-44af-9af9-0cd392339aa5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:44.694897 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6a647f79-f15c-44af-9af9-0cd392339aa5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:44.701273 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6a647f79-f15c-44af-9af9-0cd392339aa5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:44.701718 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6a647f79-f15c-44af-9af9-0cd392339aa5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:44.702481 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6a647f79-f15c-44af-9af9-0cd392339aa5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:44.702914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6a647f79-f15c-44af-9af9-0cd392339aa5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:44.762450 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6a647f79-f15c-44af-9af9-0cd392339aa5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:44.770186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6a647f79-f15c-44af-9af9-0cd392339aa5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1211 microversion: 2.1 time: 0.079281 May 27 09:42:44.770737 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 257/503] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:44 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1211 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:45.334381 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-802a57d9-c4c2-4917-92a1-266fa05c5338 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:45.335000 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-802a57d9-c4c2-4917-92a1-266fa05c5338 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:45.341608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-802a57d9-c4c2-4917-92a1-266fa05c5338 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.342052 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-802a57d9-c4c2-4917-92a1-266fa05c5338 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.342819 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-802a57d9-c4c2-4917-92a1-266fa05c5338 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.343250 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-802a57d9-c4c2-4917-92a1-266fa05c5338 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.475733 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-802a57d9-c4c2-4917-92a1-266fa05c5338 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:45.483239 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-802a57d9-c4c2-4917-92a1-266fa05c5338 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.154354 May 27 09:42:45.483828 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 247/504] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:45 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:45.787033 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6faedbbc-4906-437c-a3e0-6026d874e957 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:45.787690 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6faedbbc-4906-437c-a3e0-6026d874e957 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:45.794135 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6faedbbc-4906-437c-a3e0-6026d874e957 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.794585 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6faedbbc-4906-437c-a3e0-6026d874e957 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.795379 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6faedbbc-4906-437c-a3e0-6026d874e957 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.795819 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6faedbbc-4906-437c-a3e0-6026d874e957 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.860428 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6faedbbc-4906-437c-a3e0-6026d874e957 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:45.868664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6faedbbc-4906-437c-a3e0-6026d874e957 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1267 microversion: 2.1 time: 0.085466 May 27 09:42:45.869214 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 258/505] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:45 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:46.499684 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ca689289-87dd-4555-bbc1-b6e0b00e42ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:46.500302 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ca689289-87dd-4555-bbc1-b6e0b00e42ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:46.506678 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ca689289-87dd-4555-bbc1-b6e0b00e42ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:46.507132 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ca689289-87dd-4555-bbc1-b6e0b00e42ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:46.507938 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ca689289-87dd-4555-bbc1-b6e0b00e42ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:46.508384 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ca689289-87dd-4555-bbc1-b6e0b00e42ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:46.632002 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ca689289-87dd-4555-bbc1-b6e0b00e42ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:46.639193 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ca689289-87dd-4555-bbc1-b6e0b00e42ed tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.143326 May 27 09:42:46.639799 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 248/506] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:46 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:46.885674 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-47ca3226-ecf4-4660-b2fd-448bef268ee8 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:46.886224 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-47ca3226-ecf4-4660-b2fd-448bef268ee8 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:46.892611 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-47ca3226-ecf4-4660-b2fd-448bef268ee8 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:46.893054 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-47ca3226-ecf4-4660-b2fd-448bef268ee8 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:46.893814 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-47ca3226-ecf4-4660-b2fd-448bef268ee8 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:46.894400 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-47ca3226-ecf4-4660-b2fd-448bef268ee8 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:46.955126 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-47ca3226-ecf4-4660-b2fd-448bef268ee8 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:46.962906 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-47ca3226-ecf4-4660-b2fd-448bef268ee8 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1275 microversion: 2.1 time: 0.081184 May 27 09:42:46.963508 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 259/507] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:46 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1275 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:47.656467 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-675c071d-1927-4d0a-8f99-eed879a3ca45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:47.657051 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-675c071d-1927-4d0a-8f99-eed879a3ca45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:47.663921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-675c071d-1927-4d0a-8f99-eed879a3ca45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:47.664368 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-675c071d-1927-4d0a-8f99-eed879a3ca45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:47.665125 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-675c071d-1927-4d0a-8f99-eed879a3ca45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:47.665558 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-675c071d-1927-4d0a-8f99-eed879a3ca45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:47.796391 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-675c071d-1927-4d0a-8f99-eed879a3ca45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:47.803806 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-675c071d-1927-4d0a-8f99-eed879a3ca45 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.151286 May 27 09:42:47.804396 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 249/508] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:47 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:47.980233 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9ea7dbb9-7dbe-4ff3-af69-e37c55252926 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:47.980783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9ea7dbb9-7dbe-4ff3-af69-e37c55252926 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:47.987094 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ea7dbb9-7dbe-4ff3-af69-e37c55252926 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:47.987585 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ea7dbb9-7dbe-4ff3-af69-e37c55252926 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:47.988600 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ea7dbb9-7dbe-4ff3-af69-e37c55252926 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:47.989031 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ea7dbb9-7dbe-4ff3-af69-e37c55252926 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:48.048895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9ea7dbb9-7dbe-4ff3-af69-e37c55252926 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:48.056745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9ea7dbb9-7dbe-4ff3-af69-e37c55252926 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1275 microversion: 2.1 time: 0.080335 May 27 09:42:48.057447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 260/509] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:47 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1275 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:48.821101 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-698f1dce-7c3f-47e7-be63-bacc2661cf53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:48.821701 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-698f1dce-7c3f-47e7-be63-bacc2661cf53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:48.828081 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-698f1dce-7c3f-47e7-be63-bacc2661cf53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:48.828521 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-698f1dce-7c3f-47e7-be63-bacc2661cf53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:48.829269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-698f1dce-7c3f-47e7-be63-bacc2661cf53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:48.829697 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-698f1dce-7c3f-47e7-be63-bacc2661cf53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:48.955715 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-698f1dce-7c3f-47e7-be63-bacc2661cf53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:48.963414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-698f1dce-7c3f-47e7-be63-bacc2661cf53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.146646 May 27 09:42:48.963990 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 250/510] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:48 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:49.073489 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bd82ffe3-6408-4090-bdc0-4693457bb4fb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:49.074042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bd82ffe3-6408-4090-bdc0-4693457bb4fb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:49.080550 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd82ffe3-6408-4090-bdc0-4693457bb4fb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:49.080998 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd82ffe3-6408-4090-bdc0-4693457bb4fb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:49.081762 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd82ffe3-6408-4090-bdc0-4693457bb4fb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:49.082205 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd82ffe3-6408-4090-bdc0-4693457bb4fb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:49.346188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bd82ffe3-6408-4090-bdc0-4693457bb4fb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:49.354950 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bd82ffe3-6408-4090-bdc0-4693457bb4fb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1275 microversion: 2.1 time: 0.285225 May 27 09:42:49.355779 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 261/511] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:49 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1275 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:49.980398 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cc8227f0-5a51-49f4-b933-4aaa25c534c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:49.981141 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cc8227f0-5a51-49f4-b933-4aaa25c534c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:49.983721 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:49.989585 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cc8227f0-5a51-49f4-b933-4aaa25c534c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:49.990107 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cc8227f0-5a51-49f4-b933-4aaa25c534c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:49.990889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cc8227f0-5a51-49f4-b933-4aaa25c534c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:49.991339 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cc8227f0-5a51-49f4-b933-4aaa25c534c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:50.223070 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cc8227f0-5a51-49f4-b933-4aaa25c534c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:50.230132 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cc8227f0-5a51-49f4-b933-4aaa25c534c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.253536 May 27 09:42:50.240105 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 251/512] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:49 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:50.371807 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9023631a-a14e-4cea-af5f-128a798d57db tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:50.372716 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9023631a-a14e-4cea-af5f-128a798d57db tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:50.379098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9023631a-a14e-4cea-af5f-128a798d57db tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:50.380444 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9023631a-a14e-4cea-af5f-128a798d57db tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:50.381015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9023631a-a14e-4cea-af5f-128a798d57db tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:50.381475 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9023631a-a14e-4cea-af5f-128a798d57db tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:50.397249 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:50.623531 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9023631a-a14e-4cea-af5f-128a798d57db tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:50.630958 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9023631a-a14e-4cea-af5f-128a798d57db tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.263625 May 27 09:42:50.631618 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 262/513] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:50 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:51.078584 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-bac982c7-71e5-4e54-acd5-71955178feb3 req-5e385619-3b04-40ea-aa91-7a175790d8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26", "tag": "401f6f6d-09f1-4a96-8d38-9762d774891f"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:51.088062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:51.090838 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=6 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:51.098776 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-bac982c7-71e5-4e54-acd5-71955178feb3 req-5e385619-3b04-40ea-aa91-7a175790d8d5 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:51.099461 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-bac982c7-71e5-4e54-acd5-71955178feb3 req-5e385619-3b04-40ea-aa91-7a175790d8d5 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:51.132218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-bac982c7-71e5-4e54-acd5-71955178feb3 req-5e385619-3b04-40ea-aa91-7a175790d8d5 service nova] Creating event network-changed:401f6f6d-09f1-4a96-8d38-9762d774891f for instance c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 on hv-cinder-79760 May 27 09:42:51.140430 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-bac982c7-71e5-4e54-acd5-71955178feb3 req-5e385619-3b04-40ea-aa91-7a175790d8d5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076408 May 27 09:42:51.141266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 252/514] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:51.248027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ac45493c-879e-4328-a5fe-c83ea923c0bc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:51.248635 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ac45493c-879e-4328-a5fe-c83ea923c0bc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:51.255309 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac45493c-879e-4328-a5fe-c83ea923c0bc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:51.255751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac45493c-879e-4328-a5fe-c83ea923c0bc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:51.256526 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac45493c-879e-4328-a5fe-c83ea923c0bc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:51.256956 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ac45493c-879e-4328-a5fe-c83ea923c0bc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:51.396720 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ac45493c-879e-4328-a5fe-c83ea923c0bc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:51.404628 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ac45493c-879e-4328-a5fe-c83ea923c0bc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.160620 May 27 09:42:51.405608 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 263/515] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:51 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:51.445422 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-448af202-9b68-4cf5-a7de-75b77a9f08eb req-2582c78e-30e0-42df-86a6-680d50b048dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4572f19b-c60d-461e-8eec-9c9f8a25201c", "name": "network-vif-plugged", "status": "completed", "tag": "be291203-ca93-4891-adc1-934c52d11bd3"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:51.455087 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-448af202-9b68-4cf5-a7de-75b77a9f08eb req-2582c78e-30e0-42df-86a6-680d50b048dd service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:51.455763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-448af202-9b68-4cf5-a7de-75b77a9f08eb req-2582c78e-30e0-42df-86a6-680d50b048dd service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:51.471969 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-448af202-9b68-4cf5-a7de-75b77a9f08eb req-2582c78e-30e0-42df-86a6-680d50b048dd service nova] Creating event network-vif-plugged:be291203-ca93-4891-adc1-934c52d11bd3 for instance 4572f19b-c60d-461e-8eec-9c9f8a25201c on hv-cinder-79760 May 27 09:42:51.477129 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-448af202-9b68-4cf5-a7de-75b77a9f08eb req-2582c78e-30e0-42df-86a6-680d50b048dd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037724 May 27 09:42:51.477729 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 253/516] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:51.652624 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-563bd88a-201e-4bd0-bd98-59a71c2eb24e tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:51.656819 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-563bd88a-201e-4bd0-bd98-59a71c2eb24e tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:51.663077 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-563bd88a-201e-4bd0-bd98-59a71c2eb24e tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:51.663559 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-563bd88a-201e-4bd0-bd98-59a71c2eb24e tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:51.664332 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-563bd88a-201e-4bd0-bd98-59a71c2eb24e tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:51.664767 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-563bd88a-201e-4bd0-bd98-59a71c2eb24e tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:51.668157 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=100 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:51.798160 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-563bd88a-201e-4bd0-bd98-59a71c2eb24e tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:51.806076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-563bd88a-201e-4bd0-bd98-59a71c2eb24e tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.162447 May 27 09:42:51.808183 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 264/517] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:51 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:52.422536 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3c82ded9-cb91-439b-93f6-9e3a270ceb74 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:52.423385 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-3c82ded9-cb91-439b-93f6-9e3a270ceb74 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:52.430606 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3c82ded9-cb91-439b-93f6-9e3a270ceb74 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:52.431049 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3c82ded9-cb91-439b-93f6-9e3a270ceb74 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:52.432274 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3c82ded9-cb91-439b-93f6-9e3a270ceb74 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:52.432794 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3c82ded9-cb91-439b-93f6-9e3a270ceb74 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:52.580416 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-3c82ded9-cb91-439b-93f6-9e3a270ceb74 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:52.588958 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3c82ded9-cb91-439b-93f6-9e3a270ceb74 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.170686 May 27 09:42:52.589521 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 254/518] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:52 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:52.830408 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a836f678-d87f-4827-a84a-8b48425b926f tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:52.831888 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a836f678-d87f-4827-a84a-8b48425b926f tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:52.841776 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a836f678-d87f-4827-a84a-8b48425b926f tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:52.842148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a836f678-d87f-4827-a84a-8b48425b926f tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:52.843558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a836f678-d87f-4827-a84a-8b48425b926f tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:52.843985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a836f678-d87f-4827-a84a-8b48425b926f tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:52.994935 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a836f678-d87f-4827-a84a-8b48425b926f tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:53.002479 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a836f678-d87f-4827-a84a-8b48425b926f tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.180476 May 27 09:42:53.003262 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 265/519] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:52 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:53.606270 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9b753d48-1c79-4494-992b-dca3619773b7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:53.608036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9b753d48-1c79-4494-992b-dca3619773b7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:53.615414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9b753d48-1c79-4494-992b-dca3619773b7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:53.616153 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9b753d48-1c79-4494-992b-dca3619773b7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:53.617008 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9b753d48-1c79-4494-992b-dca3619773b7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:53.617603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9b753d48-1c79-4494-992b-dca3619773b7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:53.754636 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9b753d48-1c79-4494-992b-dca3619773b7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:53.761920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9b753d48-1c79-4494-992b-dca3619773b7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.159572 May 27 09:42:53.762481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 255/520] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:53 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:54.026477 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fdcbe1d3-ca14-4426-ac03-5e283d6b09b5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:54.030139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fdcbe1d3-ca14-4426-ac03-5e283d6b09b5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:54.041115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fdcbe1d3-ca14-4426-ac03-5e283d6b09b5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:54.042094 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fdcbe1d3-ca14-4426-ac03-5e283d6b09b5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:54.043647 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fdcbe1d3-ca14-4426-ac03-5e283d6b09b5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:54.044392 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fdcbe1d3-ca14-4426-ac03-5e283d6b09b5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:54.220075 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fdcbe1d3-ca14-4426-ac03-5e283d6b09b5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:54.229264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fdcbe1d3-ca14-4426-ac03-5e283d6b09b5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.212508 May 27 09:42:54.230129 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 266/521] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:54 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:54.782775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d50775b8-0d95-4285-8d6a-515b781f15cc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:54.783995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d50775b8-0d95-4285-8d6a-515b781f15cc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:54.790642 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d50775b8-0d95-4285-8d6a-515b781f15cc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:54.791712 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d50775b8-0d95-4285-8d6a-515b781f15cc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:54.792526 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d50775b8-0d95-4285-8d6a-515b781f15cc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:54.793162 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d50775b8-0d95-4285-8d6a-515b781f15cc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:54.975753 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d950a570-dbc8-4aca-8625-66b33641a95c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:54.976602 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d950a570-dbc8-4aca-8625-66b33641a95c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:54.985148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d950a570-dbc8-4aca-8625-66b33641a95c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:54.985854 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d950a570-dbc8-4aca-8625-66b33641a95c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:54.986849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d950a570-dbc8-4aca-8625-66b33641a95c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:54.987495 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d950a570-dbc8-4aca-8625-66b33641a95c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:55.010303 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d50775b8-0d95-4285-8d6a-515b781f15cc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:55.028081 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d50775b8-0d95-4285-8d6a-515b781f15cc tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.248600 May 27 09:42:55.029921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 256/522] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:54 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:55.166752 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-d950a570-dbc8-4aca-8625-66b33641a95c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lazy-loading 'services' on Instance uuid 410bf802-1682-4e5d-82ed-8a8603713349 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:55.248313 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f7b4b0bb-8822-446f-afd5-1e335159c8bc tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:55.249798 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f7b4b0bb-8822-446f-afd5-1e335159c8bc tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:55.270783 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f7b4b0bb-8822-446f-afd5-1e335159c8bc tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:55.271632 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f7b4b0bb-8822-446f-afd5-1e335159c8bc tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:55.272654 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f7b4b0bb-8822-446f-afd5-1e335159c8bc tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:55.273713 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f7b4b0bb-8822-446f-afd5-1e335159c8bc tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:55.323968 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d950a570-dbc8-4aca-8625-66b33641a95c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "DELETE /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349/os-volume_attachments/7e681cdd-fec4-4cdf-83e7-bba43426b212" status: 202 len: 0 microversion: 2.1 time: 0.357760 May 27 09:42:55.327700 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 267/523] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:42:54 2022] DELETE /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349/os-volume_attachments/7e681cdd-fec4-4cdf-83e7-bba43426b212 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:42:55.432345 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f7b4b0bb-8822-446f-afd5-1e335159c8bc tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:55.440792 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f7b4b0bb-8822-446f-afd5-1e335159c8bc tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.197339 May 27 09:42:55.441366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 257/524] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:55 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:56.046641 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-62afdc86-5c1c-4fe4-a51e-d91af074bcf2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:56.047252 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-62afdc86-5c1c-4fe4-a51e-d91af074bcf2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:56.049171 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=46 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:56.056315 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-62afdc86-5c1c-4fe4-a51e-d91af074bcf2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:56.057431 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-62afdc86-5c1c-4fe4-a51e-d91af074bcf2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:56.059153 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-62afdc86-5c1c-4fe4-a51e-d91af074bcf2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:56.069137 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-62afdc86-5c1c-4fe4-a51e-d91af074bcf2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:56.358443 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-62afdc86-5c1c-4fe4-a51e-d91af074bcf2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:56.370119 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-62afdc86-5c1c-4fe4-a51e-d91af074bcf2 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.326069 May 27 09:42:56.382766 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 268/525] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:56 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:56.458444 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5dfc524b-b713-4005-854e-48490eb7f2e1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:56.459747 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5dfc524b-b713-4005-854e-48490eb7f2e1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:56.470110 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dfc524b-b713-4005-854e-48490eb7f2e1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:56.473602 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dfc524b-b713-4005-854e-48490eb7f2e1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:56.474697 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dfc524b-b713-4005-854e-48490eb7f2e1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:56.476412 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dfc524b-b713-4005-854e-48490eb7f2e1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:56.661943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5dfc524b-b713-4005-854e-48490eb7f2e1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:56.670029 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5dfc524b-b713-4005-854e-48490eb7f2e1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.216192 May 27 09:42:56.670816 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 258/526] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:56 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:57.389116 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c6ebb37f-6926-4191-a24c-ef43e6b3860d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:57.389807 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c6ebb37f-6926-4191-a24c-ef43e6b3860d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:57.400654 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6ebb37f-6926-4191-a24c-ef43e6b3860d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:57.401226 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6ebb37f-6926-4191-a24c-ef43e6b3860d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:57.402095 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6ebb37f-6926-4191-a24c-ef43e6b3860d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:57.404202 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6ebb37f-6926-4191-a24c-ef43e6b3860d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:57.628837 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c6ebb37f-6926-4191-a24c-ef43e6b3860d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:57.641060 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c6ebb37f-6926-4191-a24c-ef43e6b3860d tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.256705 May 27 09:42:57.641679 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 269/527] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:57 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:57.692008 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0f8f775d-ad3d-44a3-a4b0-38203464c318 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:57.693392 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0f8f775d-ad3d-44a3-a4b0-38203464c318 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:57.700324 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f8f775d-ad3d-44a3-a4b0-38203464c318 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:57.701199 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f8f775d-ad3d-44a3-a4b0-38203464c318 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:57.702330 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f8f775d-ad3d-44a3-a4b0-38203464c318 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:57.703270 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f8f775d-ad3d-44a3-a4b0-38203464c318 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:57.864270 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0f8f775d-ad3d-44a3-a4b0-38203464c318 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:57.873471 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0f8f775d-ad3d-44a3-a4b0-38203464c318 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.189935 May 27 09:42:57.874578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 259/528] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:57 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:58.658857 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-247103da-6b3e-4eaf-9d68-ee6f91edc678 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:58.660318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-247103da-6b3e-4eaf-9d68-ee6f91edc678 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:58.669529 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-247103da-6b3e-4eaf-9d68-ee6f91edc678 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:58.670320 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-247103da-6b3e-4eaf-9d68-ee6f91edc678 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:58.671312 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-247103da-6b3e-4eaf-9d68-ee6f91edc678 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:58.672050 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-247103da-6b3e-4eaf-9d68-ee6f91edc678 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:58.896140 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-887f3e04-04b7-428e-9845-a3ac607ca80d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:58.897265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-887f3e04-04b7-428e-9845-a3ac607ca80d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:58.919038 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-887f3e04-04b7-428e-9845-a3ac607ca80d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:58.919833 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-887f3e04-04b7-428e-9845-a3ac607ca80d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:58.922125 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-887f3e04-04b7-428e-9845-a3ac607ca80d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:58.922906 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-887f3e04-04b7-428e-9845-a3ac607ca80d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:58.938388 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=100 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:58.980448 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-247103da-6b3e-4eaf-9d68-ee6f91edc678 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:59.023121 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-247103da-6b3e-4eaf-9d68-ee6f91edc678 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1371 microversion: 2.1 time: 0.362823 May 27 09:42:59.025414 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 270/529] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:58 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1371 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:59.251335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-887f3e04-04b7-428e-9845-a3ac607ca80d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:59.259702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-887f3e04-04b7-428e-9845-a3ac607ca80d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.372612 May 27 09:42:59.269275 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 260/530] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:42:58 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:00.042197 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c69e1b10-b0ab-4148-9815-d4e2a5a084f3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:00.042811 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c69e1b10-b0ab-4148-9815-d4e2a5a084f3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:00.049243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c69e1b10-b0ab-4148-9815-d4e2a5a084f3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:00.053115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c69e1b10-b0ab-4148-9815-d4e2a5a084f3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:00.054240 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c69e1b10-b0ab-4148-9815-d4e2a5a084f3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:00.056826 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c69e1b10-b0ab-4148-9815-d4e2a5a084f3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:00.111047 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-8f4b1015-6dc5-4beb-89f9-871a9a543746 req-7abc05f3-9890-44c6-9609-c270b6e573dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26", "name": "network-vif-plugged", "status": "completed", "tag": "401f6f6d-09f1-4a96-8d38-9762d774891f"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:00.133018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-8f4b1015-6dc5-4beb-89f9-871a9a543746 req-7abc05f3-9890-44c6-9609-c270b6e573dd service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:00.133460 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-8f4b1015-6dc5-4beb-89f9-871a9a543746 req-7abc05f3-9890-44c6-9609-c270b6e573dd service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:00.169599 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-8f4b1015-6dc5-4beb-89f9-871a9a543746 req-7abc05f3-9890-44c6-9609-c270b6e573dd service nova] Creating event network-vif-plugged:401f6f6d-09f1-4a96-8d38-9762d774891f for instance c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 on hv-cinder-79760 May 27 09:43:00.174802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-8f4b1015-6dc5-4beb-89f9-871a9a543746 req-7abc05f3-9890-44c6-9609-c270b6e573dd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067260 May 27 09:43:00.176613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 261/531] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:43:00.277752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0162d1fd-3692-45da-8536-e27760f8c68a tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:00.278506 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0162d1fd-3692-45da-8536-e27760f8c68a tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:00.286811 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0162d1fd-3692-45da-8536-e27760f8c68a tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:00.287257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0162d1fd-3692-45da-8536-e27760f8c68a tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:00.292037 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0162d1fd-3692-45da-8536-e27760f8c68a tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:00.292534 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0162d1fd-3692-45da-8536-e27760f8c68a tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:00.462592 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c69e1b10-b0ab-4148-9815-d4e2a5a084f3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:00.471422 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c69e1b10-b0ab-4148-9815-d4e2a5a084f3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1565 microversion: 2.1 time: 0.433393 May 27 09:43:00.483899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 271/532] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:00 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1565 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:00.489959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d1373c24-3631-4b3c-aefb-abc1c4d84d2c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:00.490661 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d1373c24-3631-4b3c-aefb-abc1c4d84d2c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:00.497013 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1373c24-3631-4b3c-aefb-abc1c4d84d2c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:00.497717 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1373c24-3631-4b3c-aefb-abc1c4d84d2c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:00.498887 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1373c24-3631-4b3c-aefb-abc1c4d84d2c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:00.499526 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d1373c24-3631-4b3c-aefb-abc1c4d84d2c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:00.902428 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0162d1fd-3692-45da-8536-e27760f8c68a tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:00.921200 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d1373c24-3631-4b3c-aefb-abc1c4d84d2c tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.435887 May 27 09:43:00.921813 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 272/533] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 09:43:00 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-interface => generated 285 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:00.930062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0162d1fd-3692-45da-8536-e27760f8c68a tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.655288 May 27 09:43:00.937455 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 262/534] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:00 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:43:01.953652 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-21f8a64a-4dc4-4acd-aa29-8452d0373b73 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:01.954287 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-21f8a64a-4dc4-4acd-aa29-8452d0373b73 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:01.967683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-21f8a64a-4dc4-4acd-aa29-8452d0373b73 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:01.968380 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-21f8a64a-4dc4-4acd-aa29-8452d0373b73 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:01.970437 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-21f8a64a-4dc4-4acd-aa29-8452d0373b73 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:01.971312 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-21f8a64a-4dc4-4acd-aa29-8452d0373b73 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:02.162650 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-21f8a64a-4dc4-4acd-aa29-8452d0373b73 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:02.170702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-21f8a64a-4dc4-4acd-aa29-8452d0373b73 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.221472 May 27 09:43:02.172614 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 273/535] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:01 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:02.295879 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-70457c0f-60da-4b7e-805f-fbbcaf2ef8d5 req-6ace260a-a09d-4a53-a868-a3404244a0fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4572f19b-c60d-461e-8eec-9c9f8a25201c", "tag": "be291203-ca93-4891-adc1-934c52d11bd3"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:02.304867 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-70457c0f-60da-4b7e-805f-fbbcaf2ef8d5 req-6ace260a-a09d-4a53-a868-a3404244a0fa service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:02.305669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-70457c0f-60da-4b7e-805f-fbbcaf2ef8d5 req-6ace260a-a09d-4a53-a868-a3404244a0fa service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:02.321096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-70457c0f-60da-4b7e-805f-fbbcaf2ef8d5 req-6ace260a-a09d-4a53-a868-a3404244a0fa service nova] Creating event network-changed:be291203-ca93-4891-adc1-934c52d11bd3 for instance 4572f19b-c60d-461e-8eec-9c9f8a25201c on hv-cinder-79760 May 27 09:43:02.328426 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-70457c0f-60da-4b7e-805f-fbbcaf2ef8d5 req-6ace260a-a09d-4a53-a868-a3404244a0fa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037332 May 27 09:43:02.329032 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 263/536] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:03.191864 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bdf3ab02-3370-4e26-85de-2e7345f9f014 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:03.192761 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bdf3ab02-3370-4e26-85de-2e7345f9f014 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:03.199985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdf3ab02-3370-4e26-85de-2e7345f9f014 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:03.200497 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdf3ab02-3370-4e26-85de-2e7345f9f014 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:03.201502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdf3ab02-3370-4e26-85de-2e7345f9f014 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:03.202031 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdf3ab02-3370-4e26-85de-2e7345f9f014 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:03.377573 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bdf3ab02-3370-4e26-85de-2e7345f9f014 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:03.385944 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bdf3ab02-3370-4e26-85de-2e7345f9f014 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.200426 May 27 09:43:03.396042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 274/537] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:03 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:04.406194 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-573f7c77-6663-4c9f-9de0-e4b2a12ba4bb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:04.407565 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-573f7c77-6663-4c9f-9de0-e4b2a12ba4bb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:04.417444 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-573f7c77-6663-4c9f-9de0-e4b2a12ba4bb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:04.418921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-573f7c77-6663-4c9f-9de0-e4b2a12ba4bb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:04.420423 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-573f7c77-6663-4c9f-9de0-e4b2a12ba4bb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:04.421183 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-573f7c77-6663-4c9f-9de0-e4b2a12ba4bb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:04.582515 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-573f7c77-6663-4c9f-9de0-e4b2a12ba4bb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:04.591466 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-573f7c77-6663-4c9f-9de0-e4b2a12ba4bb tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.193138 May 27 09:43:04.595492 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 264/538] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:04 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:05.623780 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d4475434-8fff-4a60-93bd-e6d8ba747fdf tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:05.623780 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d4475434-8fff-4a60-93bd-e6d8ba747fdf tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:05.631045 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4475434-8fff-4a60-93bd-e6d8ba747fdf tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:05.631762 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4475434-8fff-4a60-93bd-e6d8ba747fdf tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:05.632804 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4475434-8fff-4a60-93bd-e6d8ba747fdf tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:05.633743 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4475434-8fff-4a60-93bd-e6d8ba747fdf tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:05.787711 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d4475434-8fff-4a60-93bd-e6d8ba747fdf tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:05.795629 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d4475434-8fff-4a60-93bd-e6d8ba747fdf tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.177166 May 27 09:43:05.796228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 275/539] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:05 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:06.812909 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6977f312-394a-4d75-a14b-fece5ff1220d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:06.814322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6977f312-394a-4d75-a14b-fece5ff1220d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:06.822918 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6977f312-394a-4d75-a14b-fece5ff1220d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:06.823646 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6977f312-394a-4d75-a14b-fece5ff1220d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:06.824719 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6977f312-394a-4d75-a14b-fece5ff1220d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:06.825323 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6977f312-394a-4d75-a14b-fece5ff1220d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:06.960059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6977f312-394a-4d75-a14b-fece5ff1220d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:06.968669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6977f312-394a-4d75-a14b-fece5ff1220d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.159644 May 27 09:43:06.969254 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 265/540] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:06 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:07.991008 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-299c7ba1-c1f4-43a3-8485-7171865f068d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:07.991725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-299c7ba1-c1f4-43a3-8485-7171865f068d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:07.999768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-299c7ba1-c1f4-43a3-8485-7171865f068d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:08.000752 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-299c7ba1-c1f4-43a3-8485-7171865f068d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:08.001765 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-299c7ba1-c1f4-43a3-8485-7171865f068d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:08.002506 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-299c7ba1-c1f4-43a3-8485-7171865f068d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:08.178595 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-299c7ba1-c1f4-43a3-8485-7171865f068d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:08.188129 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-299c7ba1-c1f4-43a3-8485-7171865f068d tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.205238 May 27 09:43:08.189185 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 276/541] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:07 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:09.205675 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7bfe3bca-1402-4b69-aa8d-45c5a9264dc1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:09.206490 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7bfe3bca-1402-4b69-aa8d-45c5a9264dc1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:09.214064 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7bfe3bca-1402-4b69-aa8d-45c5a9264dc1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:09.214505 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7bfe3bca-1402-4b69-aa8d-45c5a9264dc1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:09.215257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7bfe3bca-1402-4b69-aa8d-45c5a9264dc1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:09.215710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7bfe3bca-1402-4b69-aa8d-45c5a9264dc1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:09.346222 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7bfe3bca-1402-4b69-aa8d-45c5a9264dc1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:09.354463 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7bfe3bca-1402-4b69-aa8d-45c5a9264dc1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1315 microversion: 2.1 time: 0.152544 May 27 09:43:09.355176 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 266/542] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:09 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:10.371138 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7442fd03-2493-4117-af45-aaa153b7a1d7 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:10.372369 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7442fd03-2493-4117-af45-aaa153b7a1d7 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:10.379792 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7442fd03-2493-4117-af45-aaa153b7a1d7 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:10.380240 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7442fd03-2493-4117-af45-aaa153b7a1d7 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:10.381013 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7442fd03-2493-4117-af45-aaa153b7a1d7 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:10.381451 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7442fd03-2493-4117-af45-aaa153b7a1d7 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:10.516981 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7442fd03-2493-4117-af45-aaa153b7a1d7 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:10.524529 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7442fd03-2493-4117-af45-aaa153b7a1d7 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1465 microversion: 2.1 time: 0.157370 May 27 09:43:10.527308 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 277/543] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:10 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:10.568884 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b161ef39-1634-4244-bb99-70ddf4ca3a85 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:10.569433 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b161ef39-1634-4244-bb99-70ddf4ca3a85 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:10.575871 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b161ef39-1634-4244-bb99-70ddf4ca3a85 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:10.576300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b161ef39-1634-4244-bb99-70ddf4ca3a85 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:10.577232 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b161ef39-1634-4244-bb99-70ddf4ca3a85 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:10.578056 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b161ef39-1634-4244-bb99-70ddf4ca3a85 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:10.604575 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b161ef39-1634-4244-bb99-70ddf4ca3a85 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:43:10.683730 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b161ef39-1634-4244-bb99-70ddf4ca3a85 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 204 len: 0 microversion: 2.1 time: 0.121956 May 27 09:43:10.684489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 267/544] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:43:10 2022] DELETE /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:43:10.693906 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-be549373-2af2-4392-b37f-ea6d15230df1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:10.694622 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-be549373-2af2-4392-b37f-ea6d15230df1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:10.700771 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be549373-2af2-4392-b37f-ea6d15230df1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:10.702074 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be549373-2af2-4392-b37f-ea6d15230df1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:10.702624 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be549373-2af2-4392-b37f-ea6d15230df1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:10.703148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be549373-2af2-4392-b37f-ea6d15230df1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:10.874499 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-be549373-2af2-4392-b37f-ea6d15230df1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:10.883777 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-be549373-2af2-4392-b37f-ea6d15230df1 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1471 microversion: 2.1 time: 0.194890 May 27 09:43:10.884803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 278/545] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:10 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:11.901677 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9fa5fd9f-17ef-4a69-86fa-7e9537e32191 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:11.902303 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9fa5fd9f-17ef-4a69-86fa-7e9537e32191 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:11.908730 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fa5fd9f-17ef-4a69-86fa-7e9537e32191 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:11.909181 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fa5fd9f-17ef-4a69-86fa-7e9537e32191 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:11.909944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fa5fd9f-17ef-4a69-86fa-7e9537e32191 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:11.910448 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9fa5fd9f-17ef-4a69-86fa-7e9537e32191 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:12.043495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9fa5fd9f-17ef-4a69-86fa-7e9537e32191 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:12.051647 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9fa5fd9f-17ef-4a69-86fa-7e9537e32191 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1471 microversion: 2.1 time: 0.153870 May 27 09:43:12.052212 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 268/546] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:11 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:13.070715 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ee1a871e-c46a-47e7-805a-465993580c1c tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:13.071402 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ee1a871e-c46a-47e7-805a-465993580c1c tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:13.078689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ee1a871e-c46a-47e7-805a-465993580c1c tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:13.079157 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ee1a871e-c46a-47e7-805a-465993580c1c tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:13.080065 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ee1a871e-c46a-47e7-805a-465993580c1c tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:13.080387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ee1a871e-c46a-47e7-805a-465993580c1c tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:13.234093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9b6440cb-2b61-4c02-bb94-e0141751373b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:13.234938 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9b6440cb-2b61-4c02-bb94-e0141751373b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:13.242558 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9b6440cb-2b61-4c02-bb94-e0141751373b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:13.243416 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9b6440cb-2b61-4c02-bb94-e0141751373b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:13.244310 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9b6440cb-2b61-4c02-bb94-e0141751373b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:13.244858 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9b6440cb-2b61-4c02-bb94-e0141751373b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:13.368550 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ee1a871e-c46a-47e7-805a-465993580c1c tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:13.376888 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ee1a871e-c46a-47e7-805a-465993580c1c tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1471 microversion: 2.1 time: 0.311679 May 27 09:43:13.377462 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 279/547] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:13 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:13.437748 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9b6440cb-2b61-4c02-bb94-e0141751373b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:13.446259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9b6440cb-2b61-4c02-bb94-e0141751373b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1596 microversion: 2.1 time: 0.216206 May 27 09:43:13.446836 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 269/548] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:13 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1596 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:43:14.395253 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-73d4396c-20e2-4d0a-ae4b-6d13a4169612 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:14.396270 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-73d4396c-20e2-4d0a-ae4b-6d13a4169612 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:14.402690 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73d4396c-20e2-4d0a-ae4b-6d13a4169612 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:14.403149 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73d4396c-20e2-4d0a-ae4b-6d13a4169612 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:14.403957 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73d4396c-20e2-4d0a-ae4b-6d13a4169612 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:14.404401 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73d4396c-20e2-4d0a-ae4b-6d13a4169612 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:14.419833 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:14.646954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-39f0c829-27ff-408b-92c5-c9efab3ec176 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:14.647477 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-39f0c829-27ff-408b-92c5-c9efab3ec176 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:14.653921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39f0c829-27ff-408b-92c5-c9efab3ec176 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:14.654380 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39f0c829-27ff-408b-92c5-c9efab3ec176 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:14.655159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39f0c829-27ff-408b-92c5-c9efab3ec176 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:14.655623 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39f0c829-27ff-408b-92c5-c9efab3ec176 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:14.681941 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-39f0c829-27ff-408b-92c5-c9efab3ec176 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:43:14.759265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-39f0c829-27ff-408b-92c5-c9efab3ec176 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "DELETE /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 204 len: 0 microversion: 2.1 time: 0.115949 May 27 09:43:14.760130 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 270/549] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:43:14 2022] DELETE /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:43:14.769972 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a8bbd8b0-3f3a-4b25-84c2-f83f1812a4b7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:14.771209 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a8bbd8b0-3f3a-4b25-84c2-f83f1812a4b7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:14.778755 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8bbd8b0-3f3a-4b25-84c2-f83f1812a4b7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:14.779203 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8bbd8b0-3f3a-4b25-84c2-f83f1812a4b7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:14.780016 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8bbd8b0-3f3a-4b25-84c2-f83f1812a4b7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:14.780451 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8bbd8b0-3f3a-4b25-84c2-f83f1812a4b7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:14.807711 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-73d4396c-20e2-4d0a-ae4b-6d13a4169612 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:14.815553 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-73d4396c-20e2-4d0a-ae4b-6d13a4169612 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1471 microversion: 2.1 time: 0.425457 May 27 09:43:14.816137 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 280/550] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:14 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1471 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:15.388856 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a8bbd8b0-3f3a-4b25-84c2-f83f1812a4b7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:15.397560 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a8bbd8b0-3f3a-4b25-84c2-f83f1812a4b7 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1512 microversion: 2.1 time: 0.632853 May 27 09:43:15.398150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 271/551] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:14 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1512 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:15.567542 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-8bbe144e-d87b-40fc-8fbc-6bfc50f047b4 req-6b1b218e-d5d5-42f0-be7b-c0ac7853558c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26", "name": "network-vif-deleted", "tag": "401f6f6d-09f1-4a96-8d38-9762d774891f"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:15.576421 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-8bbe144e-d87b-40fc-8fbc-6bfc50f047b4 req-6b1b218e-d5d5-42f0-be7b-c0ac7853558c service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:15.576868 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-8bbe144e-d87b-40fc-8fbc-6bfc50f047b4 req-6b1b218e-d5d5-42f0-be7b-c0ac7853558c service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:15.588466 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-8bbe144e-d87b-40fc-8fbc-6bfc50f047b4 req-6b1b218e-d5d5-42f0-be7b-c0ac7853558c service nova] Creating event network-vif-deleted:401f6f6d-09f1-4a96-8d38-9762d774891f for instance c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 on hv-cinder-79760 May 27 09:43:15.594137 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-8bbe144e-d87b-40fc-8fbc-6bfc50f047b4 req-6b1b218e-d5d5-42f0-be7b-c0ac7853558c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031602 May 27 09:43:15.595081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 281/552] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:15.832781 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4dd77a3b-6ecd-4f4b-8248-da24cdfa1a22 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:15.833399 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4dd77a3b-6ecd-4f4b-8248-da24cdfa1a22 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:15.839766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4dd77a3b-6ecd-4f4b-8248-da24cdfa1a22 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:15.840218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4dd77a3b-6ecd-4f4b-8248-da24cdfa1a22 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:15.840996 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4dd77a3b-6ecd-4f4b-8248-da24cdfa1a22 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:15.841542 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4dd77a3b-6ecd-4f4b-8248-da24cdfa1a22 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:15.937785 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4dd77a3b-6ecd-4f4b-8248-da24cdfa1a22 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:15.945375 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4dd77a3b-6ecd-4f4b-8248-da24cdfa1a22 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1429 microversion: 2.1 time: 0.116385 May 27 09:43:15.945951 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 272/553] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:15 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:16.416565 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8d059a65-188a-43e1-abf2-9f68177377b8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:16.417553 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8d059a65-188a-43e1-abf2-9f68177377b8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:16.425673 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8d059a65-188a-43e1-abf2-9f68177377b8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:16.426496 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8d059a65-188a-43e1-abf2-9f68177377b8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:16.428508 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8d059a65-188a-43e1-abf2-9f68177377b8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:16.429233 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8d059a65-188a-43e1-abf2-9f68177377b8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:16.642415 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8d059a65-188a-43e1-abf2-9f68177377b8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:16.651656 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8d059a65-188a-43e1-abf2-9f68177377b8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1512 microversion: 2.1 time: 0.240878 May 27 09:43:16.652255 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 282/554] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:16 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:16.964151 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:16.965176 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:16.973408 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:16.974006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:16.975089 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:16.976047 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:17.017471 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:17.018253 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:17.019666 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lazy-loading 'fault' on Instance uuid c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:43:17.075061 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b857644c1450464b8132b85271368aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51656e5a4ab48a98dad3b48f3b550d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:17.086388 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1c1871fe-d4a0-4ca7-9ba2-8b4f657b07c4 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 200 len: 1305 microversion: 2.1 time: 0.127455 May 27 09:43:17.087570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 273/555] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:16 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:17.418005 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d6ee0ee3-f34d-4223-a9e9-0448b440b5c6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-288229352"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:17.418539 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d6ee0ee3-f34d-4223-a9e9-0448b440b5c6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:17.425272 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d6ee0ee3-f34d-4223-a9e9-0448b440b5c6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:17.425747 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d6ee0ee3-f34d-4223-a9e9-0448b440b5c6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:17.426708 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d6ee0ee3-f34d-4223-a9e9-0448b440b5c6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:17.427133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d6ee0ee3-f34d-4223-a9e9-0448b440b5c6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:17.624659 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-c2989471-fbaa-4ea5-8e55-3debc68fe1fb req-c8291041-65df-46c9-951b-d4951eafff6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd942627-ce67-4a65-95dc-a589397bd130", "tag": "7adfbb2e-f976-47e6-8ad5-c96c45292acc"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:17.635426 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-c2989471-fbaa-4ea5-8e55-3debc68fe1fb req-c8291041-65df-46c9-951b-d4951eafff6a service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:17.636146 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-c2989471-fbaa-4ea5-8e55-3debc68fe1fb req-c8291041-65df-46c9-951b-d4951eafff6a service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:17.647000 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.network.security_group_api [None req-d6ee0ee3-f34d-4223-a9e9-0448b440b5c6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Adding security group baed0279-8398-4064-89ca-32033c6b1482 to port 7adfbb2e-f976-47e6-8ad5-c96c45292acc May 27 09:43:17.648414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-c2989471-fbaa-4ea5-8e55-3debc68fe1fb req-c8291041-65df-46c9-951b-d4951eafff6a service nova] Creating event network-changed:7adfbb2e-f976-47e6-8ad5-c96c45292acc for instance cd942627-ce67-4a65-95dc-a589397bd130 on hv-cinder-79760 May 27 09:43:17.653711 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-c2989471-fbaa-4ea5-8e55-3debc68fe1fb req-c8291041-65df-46c9-951b-d4951eafff6a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033817 May 27 09:43:17.654393 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 274/556] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:17.669688 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ffa011e3-1cf2-4b30-93f1-b028570ed581 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:17.670367 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ffa011e3-1cf2-4b30-93f1-b028570ed581 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:17.676672 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ffa011e3-1cf2-4b30-93f1-b028570ed581 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:17.677118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ffa011e3-1cf2-4b30-93f1-b028570ed581 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:17.677895 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ffa011e3-1cf2-4b30-93f1-b028570ed581 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:17.678314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ffa011e3-1cf2-4b30-93f1-b028570ed581 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:17.682365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:18.098452 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ffa011e3-1cf2-4b30-93f1-b028570ed581 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:18.106931 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ffa011e3-1cf2-4b30-93f1-b028570ed581 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 200 len: 1512 microversion: 2.1 time: 0.441362 May 27 09:43:18.118136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 275/557] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:17 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 1512 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:18.118136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1b923eca-f005-4b9e-b6a9-13548b3abdc5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:18.118136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1b923eca-f005-4b9e-b6a9-13548b3abdc5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] [instance: c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:18.119128 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1b923eca-f005-4b9e-b6a9-13548b3abdc5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:18.119615 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1b923eca-f005-4b9e-b6a9-13548b3abdc5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:18.120388 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1b923eca-f005-4b9e-b6a9-13548b3abdc5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:18.120833 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1b923eca-f005-4b9e-b6a9-13548b3abdc5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:18.134770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-1b923eca-f005-4b9e-b6a9-13548b3abdc5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] HTTP exception thrown: Instance c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 could not be found. May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1b923eca-f005-4b9e-b6a9-13548b3abdc5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Request method failure captured: May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 HTTP/1.1 May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJz3gZsNY5o_2e581CSp6vEHHOnj5BdBFon0vszleEo11Kw1kW7E5IiZFAicV6e1gOW-pOtXpEV5bUMqVubOqJ9rulIU7dRE5wJe1ioKkLftHWx_eL6m_75piMQ8jJSfsE0cSbHxth1SI8CWpbrNDFnKCLJpqF10tvO3AYqDtMp-guE May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: d51656e5a4ab48a98dad3b48f3b550d9 May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-VolumesNegativeTest-1951215788 May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:43:18.136386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d51656e5a4ab48a98dad3b48f3b550d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d51656e5a4ab48a98dad3b48f3b550d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d51656e5a4ab48a98dad3b48f3b550d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d51656e5a4ab48a98dad3b48f3b550d9"}]}] May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-VolumesNegativeTest-1951215788 May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: d51656e5a4ab48a98dad3b48f3b550d9 May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-VolumesNegativeTest-1951215788 May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-VolumesNegativeTest-1951215788-project May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: b857644c1450464b8132b85271368aad May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-VolumesNegativeTest-1951215788-project May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 could not be found. May 27 09:43:18.137775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26'} May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 could not be found. May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:43:18.138532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 could not be found. May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 could not be found. May 27 09:43:18.139766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:43:18.140824 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1b923eca-f005-4b9e-b6a9-13548b3abdc5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] Returning 404 to user: Instance c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:43:18.140824 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1b923eca-f005-4b9e-b6a9-13548b3abdc5 tempest-VolumesNegativeTest-1951215788 tempest-VolumesNegativeTest-1951215788-project] 10.222.0.41 "GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26" status: 404 len: 111 microversion: 2.1 time: 0.029306 May 27 09:43:18.140824 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 276/558] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:18 2022] GET /compute/v2.1/servers/c63c3d43-fda3-4bd7-a98d-4b8f8b80fa26 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:43:18.476495 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d6ee0ee3-f34d-4223-a9e9-0448b440b5c6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "POST /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/action" status: 202 len: 0 microversion: 2.1 time: 1.061639 May 27 09:43:18.477125 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 283/559] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:43:17 2022] POST /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/action => generated 0 bytes in 1064 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:43:18.485792 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a2836dfc-e1cf-478d-8298-6bd60a5aa5d2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:18.486405 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a2836dfc-e1cf-478d-8298-6bd60a5aa5d2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:18.493925 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2836dfc-e1cf-478d-8298-6bd60a5aa5d2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:18.494528 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2836dfc-e1cf-478d-8298-6bd60a5aa5d2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:18.495415 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2836dfc-e1cf-478d-8298-6bd60a5aa5d2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:18.495920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2836dfc-e1cf-478d-8298-6bd60a5aa5d2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:18.760990 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a2836dfc-e1cf-478d-8298-6bd60a5aa5d2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:18.777159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a2836dfc-e1cf-478d-8298-6bd60a5aa5d2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1642 microversion: 2.1 time: 0.294959 May 27 09:43:18.777841 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 277/560] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:18 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1642 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:43:19.126119 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b4b3a356-da6c-4af8-be36-b8507a831d1c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:19.126975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b4b3a356-da6c-4af8-be36-b8507a831d1c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: 410bf802-1682-4e5d-82ed-8a8603713349] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:19.133853 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b4b3a356-da6c-4af8-be36-b8507a831d1c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:19.134444 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b4b3a356-da6c-4af8-be36-b8507a831d1c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:19.135345 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b4b3a356-da6c-4af8-be36-b8507a831d1c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:19.135881 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b4b3a356-da6c-4af8-be36-b8507a831d1c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:19.151331 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-b4b3a356-da6c-4af8-be36-b8507a831d1c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] HTTP exception thrown: Instance 410bf802-1682-4e5d-82ed-8a8603713349 could not be found. May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b4b3a356-da6c-4af8-be36-b8507a831d1c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Request method failure captured: May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 HTTP/1.1 May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJx69AB0-_YlJnxG5L4fQEuO_aVCbf3Y3exI4ayIcBbqVSm79F1zc3ARIxSpNdO56fFZSHDTY86itnc38Oct9_53Y8eRekpW287LHMJWedl3aTxabcl24Iq-PvKEvXxAtTn08vKky_ldKA7OjWYclxOkPbZA7JmQDeOIQlA2l1xvzZ8 May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: fd5b7a3a6f5942b49b847f5d9ee9802a May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-VolumesSnapshotTestJSON-901540710 May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:43:19.152625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fd5b7a3a6f5942b49b847f5d9ee9802a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fd5b7a3a6f5942b49b847f5d9ee9802a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fd5b7a3a6f5942b49b847f5d9ee9802a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fd5b7a3a6f5942b49b847f5d9ee9802a"}]}] May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-VolumesSnapshotTestJSON-901540710 May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: fd5b7a3a6f5942b49b847f5d9ee9802a May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-901540710 May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-VolumesSnapshotTestJSON-901540710-project May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 52e6eb075ba742e68bab4ab79eb37e1d May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-VolumesSnapshotTestJSON-901540710-project May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 410bf802-1682-4e5d-82ed-8a8603713349 could not be found. May 27 09:43:19.154073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '410bf802-1682-4e5d-82ed-8a8603713349'} May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410bf802-1682-4e5d-82ed-8a8603713349 could not be found. May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:43:19.154913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410bf802-1682-4e5d-82ed-8a8603713349 could not be found. May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410bf802-1682-4e5d-82ed-8a8603713349 could not be found. May 27 09:43:19.156211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:43:19.158267 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b4b3a356-da6c-4af8-be36-b8507a831d1c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Returning 404 to user: Instance 410bf802-1682-4e5d-82ed-8a8603713349 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:43:19.159295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b4b3a356-da6c-4af8-be36-b8507a831d1c tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349" status: 404 len: 111 microversion: 2.1 time: 0.037064 May 27 09:43:19.159926 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 284/561] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:19 2022] GET /compute/v2.1/servers/410bf802-1682-4e5d-82ed-8a8603713349 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:43:19.668643 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-3037ec9c-b0bd-4db8-84d2-064c765f5c4d req-0950bb99-4aa2-4766-8739-b8dfe62c0bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410bf802-1682-4e5d-82ed-8a8603713349", "name": "network-vif-deleted", "tag": "b7c050ec-eaef-48aa-bcb9-5a8f86f2595d"}, {"name": "network-changed", "server_uuid": "cd942627-ce67-4a65-95dc-a589397bd130", "tag": "7adfbb2e-f976-47e6-8ad5-c96c45292acc"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:19.679366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-3037ec9c-b0bd-4db8-84d2-064c765f5c4d req-0950bb99-4aa2-4766-8739-b8dfe62c0bf7 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:19.679826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-3037ec9c-b0bd-4db8-84d2-064c765f5c4d req-0950bb99-4aa2-4766-8739-b8dfe62c0bf7 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:19.697354 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-3037ec9c-b0bd-4db8-84d2-064c765f5c4d req-0950bb99-4aa2-4766-8739-b8dfe62c0bf7 service nova] Creating event network-vif-deleted:b7c050ec-eaef-48aa-bcb9-5a8f86f2595d for instance 410bf802-1682-4e5d-82ed-8a8603713349 on hv-cinder-79760 May 27 09:43:19.697863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-3037ec9c-b0bd-4db8-84d2-064c765f5c4d req-0950bb99-4aa2-4766-8739-b8dfe62c0bf7 service nova] Creating event network-changed:7adfbb2e-f976-47e6-8ad5-c96c45292acc for instance cd942627-ce67-4a65-95dc-a589397bd130 on hv-cinder-79760 May 27 09:43:19.704374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-3037ec9c-b0bd-4db8-84d2-064c765f5c4d req-0950bb99-4aa2-4766-8739-b8dfe62c0bf7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039511 May 27 09:43:19.705153 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 278/562] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:31.061942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-eb5cc070-48a9-43b1-9a0c-d83b39fe3699 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:31.062934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-eb5cc070-48a9-43b1-9a0c-d83b39fe3699 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:31.069447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=33 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:31.070249 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=17 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:31.072568 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eb5cc070-48a9-43b1-9a0c-d83b39fe3699 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:31.073100 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eb5cc070-48a9-43b1-9a0c-d83b39fe3699 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:31.074208 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eb5cc070-48a9-43b1-9a0c-d83b39fe3699 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:31.074662 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eb5cc070-48a9-43b1-9a0c-d83b39fe3699 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:31.157174 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1252970908", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "networks": [{"uuid": "04049278-c636-4fe8-a556-15302f4c13d9"}]}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:31.164973 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:31.165622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=14 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:31.172852 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-eb5cc070-48a9-43b1-9a0c-d83b39fe3699 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/action" status: 200 len: 28707 microversion: 2.1 time: 0.114583 May 27 09:43:31.178908 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 285/563] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:43:31 2022] POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/action => generated 28707 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 09:43:31.210758 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.network.neutron [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] validate_networks() for [('04049278-c636-4fe8-a556-15302f4c13d9', None, None, None, None, None)] {{(pid=129291) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:43:31.549950 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Flavor limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:43:31.550369 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Image limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:43:31.550835 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Flavor pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:43:31.551239 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Image pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:43:31.551675 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:43:31.560267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:31.560706 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:31.561491 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:31.561919 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:31.578577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Getting quotas for project fd5b7a3a6f5942b49b847f5d9ee9802a. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:43:31.582887 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Getting quotas for user 52e6eb075ba742e68bab4ab79eb37e1d and project fd5b7a3a6f5942b49b847f5d9ee9802a. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:43:31.593407 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Going to run 1 instances... {{(pid=129291) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:43:31.595961 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:43:31.639958 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-04609018-deb6-4ba0-b46a-756178a20cef tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486873 May 27 09:43:31.640590 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 279/564] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:43:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:43:31.651625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1c425bed-824d-43f8-8e5c-7f7f5f0ee167 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:31.652329 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1c425bed-824d-43f8-8e5c-7f7f5f0ee167 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:31.705938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1c425bed-824d-43f8-8e5c-7f7f5f0ee167 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:31.714046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1c425bed-824d-43f8-8e5c-7f7f5f0ee167 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1219 microversion: 2.1 time: 0.066784 May 27 09:43:31.714602 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 286/565] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:31 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:32.731996 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-57d68866-b7bb-4d57-9891-aa4ce0babc5e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:32.732827 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-57d68866-b7bb-4d57-9891-aa4ce0babc5e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:32.739956 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-57d68866-b7bb-4d57-9891-aa4ce0babc5e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:32.740482 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-57d68866-b7bb-4d57-9891-aa4ce0babc5e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:32.741315 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-57d68866-b7bb-4d57-9891-aa4ce0babc5e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:32.741814 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-57d68866-b7bb-4d57-9891-aa4ce0babc5e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:32.822448 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-57d68866-b7bb-4d57-9891-aa4ce0babc5e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:32.829978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-57d68866-b7bb-4d57-9891-aa4ce0babc5e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1289 microversion: 2.1 time: 0.102677 May 27 09:43:32.830540 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 280/566] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:32 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:32.978794 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-853df3ff-dd69-453d-9f26-10c220f7e741 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:32.979851 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-853df3ff-dd69-453d-9f26-10c220f7e741 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:32.987033 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-853df3ff-dd69-453d-9f26-10c220f7e741 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:32.987702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-853df3ff-dd69-453d-9f26-10c220f7e741 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:32.988967 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-853df3ff-dd69-453d-9f26-10c220f7e741 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:32.989392 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-853df3ff-dd69-453d-9f26-10c220f7e741 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:33.129802 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-853df3ff-dd69-453d-9f26-10c220f7e741 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/action" status: 200 len: 30180 microversion: 2.20 time: 0.154961 May 27 09:43:33.130596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 287/567] 10.222.0.41 () {62 vars in 1318 bytes} [Fri May 27 09:43:32 2022] POST /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/action => generated 30180 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 09:43:33.849818 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-159e226e-4baa-4e94-9c23-4576d863d72b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:33.850533 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-159e226e-4baa-4e94-9c23-4576d863d72b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:33.857357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-159e226e-4baa-4e94-9c23-4576d863d72b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:33.857813 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-159e226e-4baa-4e94-9c23-4576d863d72b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:33.858603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-159e226e-4baa-4e94-9c23-4576d863d72b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:33.859643 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-159e226e-4baa-4e94-9c23-4576d863d72b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:34.035071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-159e226e-4baa-4e94-9c23-4576d863d72b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:34.042579 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-159e226e-4baa-4e94-9c23-4576d863d72b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1319 microversion: 2.1 time: 0.198407 May 27 09:43:34.043147 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 281/568] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:33 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:34.118452 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-42b07cc2-ccd8-4fc1-be4d-b9699c1c445f req-4de12886-f74f-47c7-a2ca-942f57005717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6e5e94-83ef-416e-9663-515180dacccf", "tag": "df0a58cc-4139-4da1-9076-f302d1e6b031"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:34.127823 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-42b07cc2-ccd8-4fc1-be4d-b9699c1c445f req-4de12886-f74f-47c7-a2ca-942f57005717 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:34.128347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-42b07cc2-ccd8-4fc1-be4d-b9699c1c445f req-4de12886-f74f-47c7-a2ca-942f57005717 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:34.140491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-42b07cc2-ccd8-4fc1-be4d-b9699c1c445f req-4de12886-f74f-47c7-a2ca-942f57005717 service nova] Creating event network-changed:df0a58cc-4139-4da1-9076-f302d1e6b031 for instance ca6e5e94-83ef-416e-9663-515180dacccf on hv-cinder-79760 May 27 09:43:34.145762 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-42b07cc2-ccd8-4fc1-be4d-b9699c1c445f req-4de12886-f74f-47c7-a2ca-942f57005717 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031453 May 27 09:43:34.146764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 288/569] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:35.063430 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d7ddad81-a6e3-4ecd-837b-e11e95234cd2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:35.064175 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d7ddad81-a6e3-4ecd-837b-e11e95234cd2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:35.072125 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d7ddad81-a6e3-4ecd-837b-e11e95234cd2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:35.072572 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d7ddad81-a6e3-4ecd-837b-e11e95234cd2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:35.073336 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d7ddad81-a6e3-4ecd-837b-e11e95234cd2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:35.073762 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d7ddad81-a6e3-4ecd-837b-e11e95234cd2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:35.198393 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d7ddad81-a6e3-4ecd-837b-e11e95234cd2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:35.205701 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d7ddad81-a6e3-4ecd-837b-e11e95234cd2 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1319 microversion: 2.1 time: 0.150232 May 27 09:43:35.206259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 282/570] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:35 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:36.224590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-818be8e4-efef-4670-8ab0-7143b3f419cc tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:36.224590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-818be8e4-efef-4670-8ab0-7143b3f419cc tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:36.230726 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-818be8e4-efef-4670-8ab0-7143b3f419cc tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:36.231168 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-818be8e4-efef-4670-8ab0-7143b3f419cc tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:36.231965 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-818be8e4-efef-4670-8ab0-7143b3f419cc tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:36.232395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-818be8e4-efef-4670-8ab0-7143b3f419cc tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:36.361243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-818be8e4-efef-4670-8ab0-7143b3f419cc tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:36.369075 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-818be8e4-efef-4670-8ab0-7143b3f419cc tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1319 microversion: 2.1 time: 0.150707 May 27 09:43:36.369629 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 289/571] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:36 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:37.385734 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4077bc0b-b261-4b17-87bc-cab06b492baa tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:37.386276 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4077bc0b-b261-4b17-87bc-cab06b492baa tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:37.392519 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4077bc0b-b261-4b17-87bc-cab06b492baa tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:37.392968 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4077bc0b-b261-4b17-87bc-cab06b492baa tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:37.393732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4077bc0b-b261-4b17-87bc-cab06b492baa tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:37.394172 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4077bc0b-b261-4b17-87bc-cab06b492baa tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:37.520018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4077bc0b-b261-4b17-87bc-cab06b492baa tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:37.527887 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4077bc0b-b261-4b17-87bc-cab06b492baa tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1319 microversion: 2.1 time: 0.146064 May 27 09:43:37.528458 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 283/572] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:37 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:38.545097 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8f183d42-2c06-4a08-a2b4-97c68168da6f tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:38.545702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8f183d42-2c06-4a08-a2b4-97c68168da6f tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:38.552749 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f183d42-2c06-4a08-a2b4-97c68168da6f tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:38.553194 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f183d42-2c06-4a08-a2b4-97c68168da6f tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:38.553950 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f183d42-2c06-4a08-a2b4-97c68168da6f tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:38.554375 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f183d42-2c06-4a08-a2b4-97c68168da6f tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:38.679122 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8f183d42-2c06-4a08-a2b4-97c68168da6f tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:38.686351 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8f183d42-2c06-4a08-a2b4-97c68168da6f tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1319 microversion: 2.1 time: 0.145065 May 27 09:43:38.686915 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 290/573] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:38 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:39.702956 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0f2a5097-0733-4403-9a9f-659a49841c0d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:39.703621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0f2a5097-0733-4403-9a9f-659a49841c0d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:39.710125 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f2a5097-0733-4403-9a9f-659a49841c0d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:39.710569 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f2a5097-0733-4403-9a9f-659a49841c0d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:39.711363 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f2a5097-0733-4403-9a9f-659a49841c0d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:39.711801 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0f2a5097-0733-4403-9a9f-659a49841c0d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:39.847839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0f2a5097-0733-4403-9a9f-659a49841c0d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:39.855857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0f2a5097-0733-4403-9a9f-659a49841c0d tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1319 microversion: 2.1 time: 0.156805 May 27 09:43:39.856420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 284/574] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:39 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:40.872979 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5094428a-e4e9-42a7-bd10-ac231f732583 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:40.873563 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5094428a-e4e9-42a7-bd10-ac231f732583 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:40.880002 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5094428a-e4e9-42a7-bd10-ac231f732583 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:40.880445 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5094428a-e4e9-42a7-bd10-ac231f732583 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:40.881195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5094428a-e4e9-42a7-bd10-ac231f732583 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:40.881622 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5094428a-e4e9-42a7-bd10-ac231f732583 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:41.006962 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5094428a-e4e9-42a7-bd10-ac231f732583 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:41.014260 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5094428a-e4e9-42a7-bd10-ac231f732583 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1319 microversion: 2.1 time: 0.145120 May 27 09:43:41.014844 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 291/575] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:40 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:42.031529 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c041043b-f06f-432c-9396-2a9e85812cc8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:42.032139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c041043b-f06f-432c-9396-2a9e85812cc8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:42.034507 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:42.035166 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=6 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:42.042161 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c041043b-f06f-432c-9396-2a9e85812cc8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:42.042609 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c041043b-f06f-432c-9396-2a9e85812cc8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:42.043409 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c041043b-f06f-432c-9396-2a9e85812cc8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:42.043841 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c041043b-f06f-432c-9396-2a9e85812cc8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:42.173365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c041043b-f06f-432c-9396-2a9e85812cc8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:42.181860 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c041043b-f06f-432c-9396-2a9e85812cc8 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1319 microversion: 2.1 time: 0.154285 May 27 09:43:42.182438 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 285/576] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:42 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:42.419703 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-6cff7fdb-7097-48ba-81cf-b746e4c7746f req-f62272c5-8695-4d8a-97ce-c33306c0dbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6e5e94-83ef-416e-9663-515180dacccf", "name": "network-vif-plugged", "status": "completed", "tag": "df0a58cc-4139-4da1-9076-f302d1e6b031"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:42.423776 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:42.430770 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-6cff7fdb-7097-48ba-81cf-b746e4c7746f req-f62272c5-8695-4d8a-97ce-c33306c0dbc5 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:42.431214 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-6cff7fdb-7097-48ba-81cf-b746e4c7746f req-f62272c5-8695-4d8a-97ce-c33306c0dbc5 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:42.441990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-6cff7fdb-7097-48ba-81cf-b746e4c7746f req-f62272c5-8695-4d8a-97ce-c33306c0dbc5 service nova] Creating event network-vif-plugged:df0a58cc-4139-4da1-9076-f302d1e6b031 for instance ca6e5e94-83ef-416e-9663-515180dacccf on hv-cinder-79760 May 27 09:43:42.447081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-6cff7fdb-7097-48ba-81cf-b746e4c7746f req-f62272c5-8695-4d8a-97ce-c33306c0dbc5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031046 May 27 09:43:42.447708 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 292/577] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:43.198053 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f3938543-9826-46e2-8c4d-54a6130f0b2a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:43.198668 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f3938543-9826-46e2-8c4d-54a6130f0b2a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:43.205168 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3938543-9826-46e2-8c4d-54a6130f0b2a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:43.205620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3938543-9826-46e2-8c4d-54a6130f0b2a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:43.206386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3938543-9826-46e2-8c4d-54a6130f0b2a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:43.206829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3938543-9826-46e2-8c4d-54a6130f0b2a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:43.332305 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f3938543-9826-46e2-8c4d-54a6130f0b2a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:43.340287 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f3938543-9826-46e2-8c4d-54a6130f0b2a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1319 microversion: 2.1 time: 0.146178 May 27 09:43:43.340863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 286/578] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:43 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:44.107670 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ecf60d9a-2278-463c-b42c-79d436f0f1b6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:44.108375 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ecf60d9a-2278-463c-b42c-79d436f0f1b6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:44.114538 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ecf60d9a-2278-463c-b42c-79d436f0f1b6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:44.114992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ecf60d9a-2278-463c-b42c-79d436f0f1b6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:44.115779 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ecf60d9a-2278-463c-b42c-79d436f0f1b6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:44.116219 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ecf60d9a-2278-463c-b42c-79d436f0f1b6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:44.138644 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ecf60d9a-2278-463c-b42c-79d436f0f1b6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/ips" status: 200 len: 151 microversion: 2.20 time: 0.035664 May 27 09:43:44.139216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 293/579] 10.222.0.41 () {60 vars in 1288 bytes} [Fri May 27 09:43:44 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:43:44.357853 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d27660a9-4bb9-4a4d-af20-702bd9dbedec tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:44.358546 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d27660a9-4bb9-4a4d-af20-702bd9dbedec tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:44.371740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d27660a9-4bb9-4a4d-af20-702bd9dbedec tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:44.372299 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d27660a9-4bb9-4a4d-af20-702bd9dbedec tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:44.373056 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d27660a9-4bb9-4a4d-af20-702bd9dbedec tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:44.373474 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d27660a9-4bb9-4a4d-af20-702bd9dbedec tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:44.510737 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d27660a9-4bb9-4a4d-af20-702bd9dbedec tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:44.518060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d27660a9-4bb9-4a4d-af20-702bd9dbedec tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1319 microversion: 2.1 time: 0.164089 May 27 09:43:44.518620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 287/580] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:44 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:45.534772 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-48e0f361-1f18-42cb-b5d3-7e245c859ec1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:45.535420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-48e0f361-1f18-42cb-b5d3-7e245c859ec1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:45.542425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-48e0f361-1f18-42cb-b5d3-7e245c859ec1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:45.542874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-48e0f361-1f18-42cb-b5d3-7e245c859ec1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:45.543685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-48e0f361-1f18-42cb-b5d3-7e245c859ec1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:45.544127 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-48e0f361-1f18-42cb-b5d3-7e245c859ec1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:45.674034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-48e0f361-1f18-42cb-b5d3-7e245c859ec1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:45.681462 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-48e0f361-1f18-42cb-b5d3-7e245c859ec1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1507 microversion: 2.1 time: 0.150532 May 27 09:43:45.682042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 294/581] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:43:45 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:43:45.697524 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-466608c6-0cc1-4158-86f2-d88415be2902 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d69d7efc-7147-4c03-b27f-372a6d73a81d", "device": "/dev/sdb"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:45.699220 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-466608c6-0cc1-4158-86f2-d88415be2902 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:45.706256 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-466608c6-0cc1-4158-86f2-d88415be2902 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:45.706707 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-466608c6-0cc1-4158-86f2-d88415be2902 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:45.707561 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-466608c6-0cc1-4158-86f2-d88415be2902 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:45.708537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-466608c6-0cc1-4158-86f2-d88415be2902 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:45.957331 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-466608c6-0cc1-4158-86f2-d88415be2902 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "POST /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263511 May 27 09:43:45.957930 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 288/582] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:43:45 2022] POST /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:47.108145 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ef117712-7692-425d-b193-01a9b2568984 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:47.108679 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ef117712-7692-425d-b193-01a9b2568984 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:47.115105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ef117712-7692-425d-b193-01a9b2568984 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:47.115581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ef117712-7692-425d-b193-01a9b2568984 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:47.116338 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ef117712-7692-425d-b193-01a9b2568984 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:47.116772 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ef117712-7692-425d-b193-01a9b2568984 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:47.150673 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-ef117712-7692-425d-b193-01a9b2568984 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lazy-loading 'flavor' on Instance uuid c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:43:47.410111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ef117712-7692-425d-b193-01a9b2568984 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/action" status: 202 len: 0 microversion: 2.20 time: 0.305643 May 27 09:43:47.410715 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 295/583] 10.222.0.41 () {62 vars in 1318 bytes} [Fri May 27 09:43:47 2022] POST /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 09:43:47.419877 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ff489652-249e-4d1c-b57c-232e3a3410e4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:47.420572 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ff489652-249e-4d1c-b57c-232e3a3410e4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:47.426719 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff489652-249e-4d1c-b57c-232e3a3410e4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:47.427174 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff489652-249e-4d1c-b57c-232e3a3410e4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:47.428033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff489652-249e-4d1c-b57c-232e3a3410e4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:47.428449 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff489652-249e-4d1c-b57c-232e3a3410e4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:47.558327 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ff489652-249e-4d1c-b57c-232e3a3410e4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:47.566184 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ff489652-249e-4d1c-b57c-232e3a3410e4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:47.568249 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ff489652-249e-4d1c-b57c-232e3a3410e4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:47.569377 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ff489652-249e-4d1c-b57c-232e3a3410e4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.154200 May 27 09:43:47.569936 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 289/584] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:47 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:47.675212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b40b0e6d-5388-404d-aea4-bb69a5aa1f82 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:47.675866 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b40b0e6d-5388-404d-aea4-bb69a5aa1f82 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:47.682720 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b40b0e6d-5388-404d-aea4-bb69a5aa1f82 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:47.683162 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b40b0e6d-5388-404d-aea4-bb69a5aa1f82 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:47.683944 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b40b0e6d-5388-404d-aea4-bb69a5aa1f82 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:47.684386 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b40b0e6d-5388-404d-aea4-bb69a5aa1f82 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:47.706751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b40b0e6d-5388-404d-aea4-bb69a5aa1f82 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/ips" status: 200 len: 146 microversion: 2.1 time: 0.035742 May 27 09:43:47.707331 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 296/585] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 09:43:47 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:48.588349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-30b4f4b0-76ee-42c3-829e-7c39ddd738a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:48.588973 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-30b4f4b0-76ee-42c3-829e-7c39ddd738a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:48.595763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30b4f4b0-76ee-42c3-829e-7c39ddd738a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:48.596234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30b4f4b0-76ee-42c3-829e-7c39ddd738a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:48.596980 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30b4f4b0-76ee-42c3-829e-7c39ddd738a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:48.597416 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30b4f4b0-76ee-42c3-829e-7c39ddd738a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:48.728901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-30b4f4b0-76ee-42c3-829e-7c39ddd738a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:48.736757 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-30b4f4b0-76ee-42c3-829e-7c39ddd738a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:48.738249 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-30b4f4b0-76ee-42c3-829e-7c39ddd738a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:48.739416 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-30b4f4b0-76ee-42c3-829e-7c39ddd738a8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.154914 May 27 09:43:48.739967 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 290/586] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:48 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:49.757712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-eaa4e615-9e7a-45fa-bff1-893d59303a3e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:49.758317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-eaa4e615-9e7a-45fa-bff1-893d59303a3e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:49.764782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eaa4e615-9e7a-45fa-bff1-893d59303a3e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:49.765231 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eaa4e615-9e7a-45fa-bff1-893d59303a3e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:49.765990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eaa4e615-9e7a-45fa-bff1-893d59303a3e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:49.766422 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eaa4e615-9e7a-45fa-bff1-893d59303a3e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:50.070900 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-eaa4e615-9e7a-45fa-bff1-893d59303a3e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:50.078945 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-eaa4e615-9e7a-45fa-bff1-893d59303a3e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:50.080525 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-eaa4e615-9e7a-45fa-bff1-893d59303a3e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:50.081685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-eaa4e615-9e7a-45fa-bff1-893d59303a3e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.327866 May 27 09:43:50.082235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 297/587] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:49 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:51.036462 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c3c3d8b8-d1a3-4f3f-b147-349a220a4dec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6ad0780-81c7-4ee1-b71a-e0b309664b21"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:51.037557 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c3c3d8b8-d1a3-4f3f-b147-349a220a4dec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:51.044003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c3c3d8b8-d1a3-4f3f-b147-349a220a4dec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:51.044456 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c3c3d8b8-d1a3-4f3f-b147-349a220a4dec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:51.045213 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c3c3d8b8-d1a3-4f3f-b147-349a220a4dec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:51.045647 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c3c3d8b8-d1a3-4f3f-b147-349a220a4dec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:51.102060 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5866516a-3ddc-4803-ab81-cca27b08ec27 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:51.102673 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5866516a-3ddc-4803-ab81-cca27b08ec27 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:51.109100 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5866516a-3ddc-4803-ab81-cca27b08ec27 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:51.109555 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5866516a-3ddc-4803-ab81-cca27b08ec27 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:51.110317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5866516a-3ddc-4803-ab81-cca27b08ec27 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:51.110762 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5866516a-3ddc-4803-ab81-cca27b08ec27 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:51.246163 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5866516a-3ddc-4803-ab81-cca27b08ec27 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:51.255966 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5866516a-3ddc-4803-ab81-cca27b08ec27 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:51.257631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5866516a-3ddc-4803-ab81-cca27b08ec27 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:51.258909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5866516a-3ddc-4803-ab81-cca27b08ec27 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.161220 May 27 09:43:51.259591 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 298/588] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:51 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:43:51.414501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c3c3d8b8-d1a3-4f3f-b147-349a220a4dec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381836 May 27 09:43:51.415146 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 291/589] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:43:51 2022] POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:43:52.277784 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-11938a4b-bdaa-472f-908e-94bf59b00d7e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:52.278391 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-11938a4b-bdaa-472f-908e-94bf59b00d7e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:52.284825 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11938a4b-bdaa-472f-908e-94bf59b00d7e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:52.285270 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11938a4b-bdaa-472f-908e-94bf59b00d7e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:52.286016 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11938a4b-bdaa-472f-908e-94bf59b00d7e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:52.287111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11938a4b-bdaa-472f-908e-94bf59b00d7e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:52.413450 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-11938a4b-bdaa-472f-908e-94bf59b00d7e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:52.421420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-11938a4b-bdaa-472f-908e-94bf59b00d7e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:52.422921 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-11938a4b-bdaa-472f-908e-94bf59b00d7e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:52.424105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-11938a4b-bdaa-472f-908e-94bf59b00d7e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.150298 May 27 09:43:52.424655 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 299/590] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:52 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:53.443982 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e6e37f2d-a98f-40a3-ab63-9f8a31223caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:53.444675 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e6e37f2d-a98f-40a3-ab63-9f8a31223caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:53.451016 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e6e37f2d-a98f-40a3-ab63-9f8a31223caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:53.451504 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e6e37f2d-a98f-40a3-ab63-9f8a31223caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:53.452361 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e6e37f2d-a98f-40a3-ab63-9f8a31223caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:53.452803 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e6e37f2d-a98f-40a3-ab63-9f8a31223caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:53.605604 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e6e37f2d-a98f-40a3-ab63-9f8a31223caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:53.613785 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e6e37f2d-a98f-40a3-ab63-9f8a31223caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:53.615537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e6e37f2d-a98f-40a3-ab63-9f8a31223caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:53.616709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e6e37f2d-a98f-40a3-ab63-9f8a31223caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.178050 May 27 09:43:53.617276 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 292/591] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:53 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:54.635051 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-32f8a68b-fb00-4981-9de9-b6849c491db7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:54.635598 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-32f8a68b-fb00-4981-9de9-b6849c491db7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:54.642117 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-32f8a68b-fb00-4981-9de9-b6849c491db7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:54.642566 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-32f8a68b-fb00-4981-9de9-b6849c491db7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:54.643345 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-32f8a68b-fb00-4981-9de9-b6849c491db7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:54.643775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-32f8a68b-fb00-4981-9de9-b6849c491db7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:54.772733 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-32f8a68b-fb00-4981-9de9-b6849c491db7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:54.780615 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-32f8a68b-fb00-4981-9de9-b6849c491db7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:54.782119 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-32f8a68b-fb00-4981-9de9-b6849c491db7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:54.783289 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-32f8a68b-fb00-4981-9de9-b6849c491db7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.152155 May 27 09:43:54.783846 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 300/592] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:54 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:55.802109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-436f6632-09a2-4a86-a686-222da92dd22b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:55.802744 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-436f6632-09a2-4a86-a686-222da92dd22b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:55.809293 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-436f6632-09a2-4a86-a686-222da92dd22b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:55.809742 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-436f6632-09a2-4a86-a686-222da92dd22b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:55.810495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-436f6632-09a2-4a86-a686-222da92dd22b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:55.810928 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-436f6632-09a2-4a86-a686-222da92dd22b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:55.828782 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:55.946897 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-436f6632-09a2-4a86-a686-222da92dd22b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:55.954902 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-436f6632-09a2-4a86-a686-222da92dd22b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:55.956455 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-436f6632-09a2-4a86-a686-222da92dd22b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:55.957612 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-436f6632-09a2-4a86-a686-222da92dd22b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.159499 May 27 09:43:55.958207 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 293/593] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:55 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:56.976486 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-3a47da6c-0ddf-4131-ba64-e1cd98b6686a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:56.977001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3a47da6c-0ddf-4131-ba64-e1cd98b6686a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:56.983493 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3a47da6c-0ddf-4131-ba64-e1cd98b6686a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:56.983942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3a47da6c-0ddf-4131-ba64-e1cd98b6686a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:56.984706 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3a47da6c-0ddf-4131-ba64-e1cd98b6686a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:56.985144 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3a47da6c-0ddf-4131-ba64-e1cd98b6686a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:57.114312 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-3a47da6c-0ddf-4131-ba64-e1cd98b6686a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:57.122233 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-3a47da6c-0ddf-4131-ba64-e1cd98b6686a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:57.123814 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-3a47da6c-0ddf-4131-ba64-e1cd98b6686a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:57.125013 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3a47da6c-0ddf-4131-ba64-e1cd98b6686a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.153140 May 27 09:43:57.125581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 301/594] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:56 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:58.144640 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f98ac855-0f2c-49e4-b99f-262d50c1736e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:58.145249 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f98ac855-0f2c-49e4-b99f-262d50c1736e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:58.151736 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f98ac855-0f2c-49e4-b99f-262d50c1736e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:58.152182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f98ac855-0f2c-49e4-b99f-262d50c1736e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:58.152947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f98ac855-0f2c-49e4-b99f-262d50c1736e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:58.153382 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f98ac855-0f2c-49e4-b99f-262d50c1736e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:58.277648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f98ac855-0f2c-49e4-b99f-262d50c1736e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:58.285375 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f98ac855-0f2c-49e4-b99f-262d50c1736e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:58.287559 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f98ac855-0f2c-49e4-b99f-262d50c1736e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:58.288699 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f98ac855-0f2c-49e4-b99f-262d50c1736e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.147974 May 27 09:43:58.289253 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 294/595] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:58 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:59.307416 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4da8da48-05c8-4d9d-b1fa-2d38bc58b0d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:59.308024 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4da8da48-05c8-4d9d-b1fa-2d38bc58b0d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:59.314407 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4da8da48-05c8-4d9d-b1fa-2d38bc58b0d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:59.314849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4da8da48-05c8-4d9d-b1fa-2d38bc58b0d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:59.315634 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4da8da48-05c8-4d9d-b1fa-2d38bc58b0d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:59.316112 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4da8da48-05c8-4d9d-b1fa-2d38bc58b0d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:59.446835 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4da8da48-05c8-4d9d-b1fa-2d38bc58b0d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:59.455397 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4da8da48-05c8-4d9d-b1fa-2d38bc58b0d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:59.457162 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4da8da48-05c8-4d9d-b1fa-2d38bc58b0d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:59.458355 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4da8da48-05c8-4d9d-b1fa-2d38bc58b0d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.154937 May 27 09:43:59.458916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 302/596] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:43:59 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:00.477998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d0be598a-2d4c-488a-8665-2c03b3735c15 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:00.478542 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d0be598a-2d4c-488a-8665-2c03b3735c15 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:00.485016 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d0be598a-2d4c-488a-8665-2c03b3735c15 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:00.485460 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d0be598a-2d4c-488a-8665-2c03b3735c15 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:00.486238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d0be598a-2d4c-488a-8665-2c03b3735c15 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:00.486663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d0be598a-2d4c-488a-8665-2c03b3735c15 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:00.611449 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d0be598a-2d4c-488a-8665-2c03b3735c15 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:00.620069 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d0be598a-2d4c-488a-8665-2c03b3735c15 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:00.621577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d0be598a-2d4c-488a-8665-2c03b3735c15 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:00.622723 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d0be598a-2d4c-488a-8665-2c03b3735c15 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.149357 May 27 09:44:00.623320 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 295/597] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:00 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:01.640405 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f6dfd008-dd03-4427-a0fd-0b78b18c84a6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:01.641022 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f6dfd008-dd03-4427-a0fd-0b78b18c84a6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:01.643490 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=39 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:01.648834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f6dfd008-dd03-4427-a0fd-0b78b18c84a6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:01.649315 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f6dfd008-dd03-4427-a0fd-0b78b18c84a6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:01.650078 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f6dfd008-dd03-4427-a0fd-0b78b18c84a6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:01.650511 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f6dfd008-dd03-4427-a0fd-0b78b18c84a6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:01.653223 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:01.779968 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f6dfd008-dd03-4427-a0fd-0b78b18c84a6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:01.788337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f6dfd008-dd03-4427-a0fd-0b78b18c84a6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:01.789875 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f6dfd008-dd03-4427-a0fd-0b78b18c84a6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:01.791049 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f6dfd008-dd03-4427-a0fd-0b78b18c84a6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.154545 May 27 09:44:01.791656 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 303/598] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:01 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:02.808827 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c922ca57-3a8d-45aa-88a1-43ee31c0ed1d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:02.809445 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c922ca57-3a8d-45aa-88a1-43ee31c0ed1d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:02.811753 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:02.816968 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c922ca57-3a8d-45aa-88a1-43ee31c0ed1d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:02.817419 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c922ca57-3a8d-45aa-88a1-43ee31c0ed1d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:02.818806 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c922ca57-3a8d-45aa-88a1-43ee31c0ed1d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:02.819241 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c922ca57-3a8d-45aa-88a1-43ee31c0ed1d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:02.946026 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c922ca57-3a8d-45aa-88a1-43ee31c0ed1d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:02.953936 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c922ca57-3a8d-45aa-88a1-43ee31c0ed1d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:02.955476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c922ca57-3a8d-45aa-88a1-43ee31c0ed1d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:02.956628 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c922ca57-3a8d-45aa-88a1-43ee31c0ed1d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.151766 May 27 09:44:02.957225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 296/599] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:02 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:03.975242 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f3a3cc73-1546-4774-abac-f530dd091c63 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:03.975912 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f3a3cc73-1546-4774-abac-f530dd091c63 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:03.982304 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f3a3cc73-1546-4774-abac-f530dd091c63 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:03.982747 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f3a3cc73-1546-4774-abac-f530dd091c63 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:03.983533 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f3a3cc73-1546-4774-abac-f530dd091c63 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:03.983964 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f3a3cc73-1546-4774-abac-f530dd091c63 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:04.113432 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f3a3cc73-1546-4774-abac-f530dd091c63 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:04.121356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f3a3cc73-1546-4774-abac-f530dd091c63 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:04.122846 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f3a3cc73-1546-4774-abac-f530dd091c63 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:04.124007 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f3a3cc73-1546-4774-abac-f530dd091c63 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.152835 May 27 09:44:04.124564 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 304/600] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:03 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:05.142703 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-41170855-bbf4-47fc-8370-adc8fd664d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:05.143406 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-41170855-bbf4-47fc-8370-adc8fd664d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:05.150063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-41170855-bbf4-47fc-8370-adc8fd664d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:05.150508 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-41170855-bbf4-47fc-8370-adc8fd664d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:05.151267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-41170855-bbf4-47fc-8370-adc8fd664d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:05.151732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-41170855-bbf4-47fc-8370-adc8fd664d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:05.280238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-41170855-bbf4-47fc-8370-adc8fd664d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:05.287954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-41170855-bbf4-47fc-8370-adc8fd664d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:05.289479 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-41170855-bbf4-47fc-8370-adc8fd664d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:05.290642 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-41170855-bbf4-47fc-8370-adc8fd664d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.151818 May 27 09:44:05.291201 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 297/601] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:05 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:06.304394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-39e2ea8a-d84f-407a-96b2-e5da541294d8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:06.312261 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-39e2ea8a-d84f-407a-96b2-e5da541294d8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:06.312705 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-39e2ea8a-d84f-407a-96b2-e5da541294d8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:06.374581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-39e2ea8a-d84f-407a-96b2-e5da541294d8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Going to try to stop instance {{(pid=129290) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 09:44:06.423670 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-39e2ea8a-d84f-407a-96b2-e5da541294d8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/action" status: 202 len: 0 microversion: 2.1 time: 0.122667 May 27 09:44:06.424482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 305/602] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:44:06 2022] POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:44:06.432616 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4c24d939-739a-4bcd-8661-d1dcf65e8b5a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:06.433302 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4c24d939-739a-4bcd-8661-d1dcf65e8b5a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:06.434978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fb1d6416-3016-44f0-bb6c-158122a0e6b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:06.435631 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-fb1d6416-3016-44f0-bb6c-158122a0e6b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:06.440720 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4c24d939-739a-4bcd-8661-d1dcf65e8b5a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:06.441170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4c24d939-739a-4bcd-8661-d1dcf65e8b5a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:06.441738 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb1d6416-3016-44f0-bb6c-158122a0e6b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:06.441942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4c24d939-739a-4bcd-8661-d1dcf65e8b5a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:06.442377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4c24d939-739a-4bcd-8661-d1dcf65e8b5a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:06.442501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb1d6416-3016-44f0-bb6c-158122a0e6b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:06.443171 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb1d6416-3016-44f0-bb6c-158122a0e6b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:06.443611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb1d6416-3016-44f0-bb6c-158122a0e6b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:06.916064 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fb1d6416-3016-44f0-bb6c-158122a0e6b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:06.920712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4c24d939-739a-4bcd-8661-d1dcf65e8b5a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:06.928725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4c24d939-739a-4bcd-8661-d1dcf65e8b5a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.500261 May 27 09:44:06.929523 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 306/603] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:06 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:44:06.931792 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fb1d6416-3016-44f0-bb6c-158122a0e6b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:06.933308 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fb1d6416-3016-44f0-bb6c-158122a0e6b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:06.934815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fb1d6416-3016-44f0-bb6c-158122a0e6b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.627316 May 27 09:44:06.935401 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 298/604] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:06 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:44:07.946409 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-aa253a44-e7c6-4671-ad18-779312af6712 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:07.947845 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-aa253a44-e7c6-4671-ad18-779312af6712 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:07.952567 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8f019877-efea-4d85-b385-489ec269fe3a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:07.953177 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8f019877-efea-4d85-b385-489ec269fe3a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:07.954256 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa253a44-e7c6-4671-ad18-779312af6712 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:07.954702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa253a44-e7c6-4671-ad18-779312af6712 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:07.955686 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa253a44-e7c6-4671-ad18-779312af6712 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:07.956122 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-aa253a44-e7c6-4671-ad18-779312af6712 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:07.959510 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f019877-efea-4d85-b385-489ec269fe3a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:07.959966 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f019877-efea-4d85-b385-489ec269fe3a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:07.960728 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f019877-efea-4d85-b385-489ec269fe3a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:07.961173 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8f019877-efea-4d85-b385-489ec269fe3a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:08.144499 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-aa253a44-e7c6-4671-ad18-779312af6712 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:08.147565 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8f019877-efea-4d85-b385-489ec269fe3a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:08.152531 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-aa253a44-e7c6-4671-ad18-779312af6712 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.209948 May 27 09:44:08.153178 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 307/605] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:07 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:08.166269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8f019877-efea-4d85-b385-489ec269fe3a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:08.167885 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8f019877-efea-4d85-b385-489ec269fe3a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:08.169094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8f019877-efea-4d85-b385-489ec269fe3a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.220333 May 27 09:44:08.169653 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 299/606] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:07 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:44:09.170223 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-721f428b-beae-4598-a3a9-7e4afb94fc16 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:09.170843 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-721f428b-beae-4598-a3a9-7e4afb94fc16 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:09.179678 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-721f428b-beae-4598-a3a9-7e4afb94fc16 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:09.180127 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-721f428b-beae-4598-a3a9-7e4afb94fc16 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:09.180940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-721f428b-beae-4598-a3a9-7e4afb94fc16 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:09.181385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-721f428b-beae-4598-a3a9-7e4afb94fc16 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:09.187971 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dab9d2f5-9d57-4c13-af66-0ecee2d7b836 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:09.188610 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dab9d2f5-9d57-4c13-af66-0ecee2d7b836 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:09.195088 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dab9d2f5-9d57-4c13-af66-0ecee2d7b836 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:09.195580 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dab9d2f5-9d57-4c13-af66-0ecee2d7b836 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:09.196388 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dab9d2f5-9d57-4c13-af66-0ecee2d7b836 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:09.197769 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dab9d2f5-9d57-4c13-af66-0ecee2d7b836 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:09.374115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-721f428b-beae-4598-a3a9-7e4afb94fc16 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:09.382305 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-721f428b-beae-4598-a3a9-7e4afb94fc16 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.216346 May 27 09:44:09.383073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 308/607] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:09 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:09.386909 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dab9d2f5-9d57-4c13-af66-0ecee2d7b836 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:09.394920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dab9d2f5-9d57-4c13-af66-0ecee2d7b836 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:09.396461 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dab9d2f5-9d57-4c13-af66-0ecee2d7b836 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:09.397593 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dab9d2f5-9d57-4c13-af66-0ecee2d7b836 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1743 microversion: 2.20 time: 0.214116 May 27 09:44:09.398134 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 300/608] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:09 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1743 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:44:10.421067 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-175b0584-3f84-4c74-a4d2-c538a62690f3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:10.425884 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-175b0584-3f84-4c74-a4d2-c538a62690f3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:10.436056 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-175b0584-3f84-4c74-a4d2-c538a62690f3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:10.436505 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-175b0584-3f84-4c74-a4d2-c538a62690f3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:10.437267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-175b0584-3f84-4c74-a4d2-c538a62690f3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:10.437697 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-175b0584-3f84-4c74-a4d2-c538a62690f3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:10.518034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-91e90b1e-0fbc-428d-9445-8108133ac4dc tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:10.518644 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-91e90b1e-0fbc-428d-9445-8108133ac4dc tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:10.524734 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-91e90b1e-0fbc-428d-9445-8108133ac4dc tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:10.525201 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-91e90b1e-0fbc-428d-9445-8108133ac4dc tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:10.525955 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-91e90b1e-0fbc-428d-9445-8108133ac4dc tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:10.526553 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-91e90b1e-0fbc-428d-9445-8108133ac4dc tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:10.582120 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-175b0584-3f84-4c74-a4d2-c538a62690f3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:10.590040 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-175b0584-3f84-4c74-a4d2-c538a62690f3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:10.591613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-175b0584-3f84-4c74-a4d2-c538a62690f3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:10.592771 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-175b0584-3f84-4c74-a4d2-c538a62690f3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1743 microversion: 2.20 time: 0.178324 May 27 09:44:10.593606 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 301/609] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:10 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:10.598395 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2905853f-fd92-4971-b446-7b266818d88e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:10.598825 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2905853f-fd92-4971-b446-7b266818d88e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:10.606191 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2905853f-fd92-4971-b446-7b266818d88e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:10.606651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2905853f-fd92-4971-b446-7b266818d88e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:10.607464 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2905853f-fd92-4971-b446-7b266818d88e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:10.607906 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2905853f-fd92-4971-b446-7b266818d88e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:10.664554 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-91e90b1e-0fbc-428d-9445-8108133ac4dc tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:10.673533 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-91e90b1e-0fbc-428d-9445-8108133ac4dc tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.278342 May 27 09:44:10.674109 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 309/610] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:10 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:10.737653 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-2905853f-fd92-4971-b446-7b266818d88e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lazy-loading 'services' on Instance uuid ca6e5e94-83ef-416e-9663-515180dacccf {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:44:10.845796 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2905853f-fd92-4971-b446-7b266818d88e tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf/os-volume_attachments/d69d7efc-7147-4c03-b27f-372a6d73a81d" status: 202 len: 0 microversion: 2.1 time: 0.250781 May 27 09:44:10.846425 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 302/611] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:44:10 2022] DELETE /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf/os-volume_attachments/d69d7efc-7147-4c03-b27f-372a6d73a81d => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:44:11.611383 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-81af0d88-e6b0-4721-acbf-b9fcd043ea84 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:11.611993 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-81af0d88-e6b0-4721-acbf-b9fcd043ea84 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:11.618393 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81af0d88-e6b0-4721-acbf-b9fcd043ea84 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:11.618841 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81af0d88-e6b0-4721-acbf-b9fcd043ea84 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:11.620169 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81af0d88-e6b0-4721-acbf-b9fcd043ea84 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:11.620604 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81af0d88-e6b0-4721-acbf-b9fcd043ea84 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:11.693120 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a4fd23c5-6fdc-4901-9494-d816d91a06cd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:11.693849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a4fd23c5-6fdc-4901-9494-d816d91a06cd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:11.700934 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a4fd23c5-6fdc-4901-9494-d816d91a06cd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:11.701531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a4fd23c5-6fdc-4901-9494-d816d91a06cd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:11.708317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a4fd23c5-6fdc-4901-9494-d816d91a06cd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:11.709260 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a4fd23c5-6fdc-4901-9494-d816d91a06cd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:11.784297 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-81af0d88-e6b0-4721-acbf-b9fcd043ea84 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:11.792377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-81af0d88-e6b0-4721-acbf-b9fcd043ea84 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:11.794001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-81af0d88-e6b0-4721-acbf-b9fcd043ea84 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:11.795166 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-81af0d88-e6b0-4721-acbf-b9fcd043ea84 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1743 microversion: 2.20 time: 0.187687 May 27 09:44:11.795907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 310/612] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:11 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:11.848405 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a4fd23c5-6fdc-4901-9494-d816d91a06cd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:11.856399 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a4fd23c5-6fdc-4901-9494-d816d91a06cd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.168100 May 27 09:44:11.857186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 303/613] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:11 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:44:12.384060 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-4692830f-f21d-4d79-91aa-9a70dd80f993 req-bc0a4fe1-8119-4099-adc7-7e774a8d5030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7937af8-bbeb-4a70-bd98-1062cbe0d4c7", "name": "network-vif-plugged", "status": "completed", "tag": "6328b701-4055-487d-8cef-ec0bdfa4ceda"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:12.392831 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-4692830f-f21d-4d79-91aa-9a70dd80f993 req-bc0a4fe1-8119-4099-adc7-7e774a8d5030 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:12.393273 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-4692830f-f21d-4d79-91aa-9a70dd80f993 req-bc0a4fe1-8119-4099-adc7-7e774a8d5030 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:12.405444 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-4692830f-f21d-4d79-91aa-9a70dd80f993 req-bc0a4fe1-8119-4099-adc7-7e774a8d5030 service nova] Creating event network-vif-plugged:6328b701-4055-487d-8cef-ec0bdfa4ceda for instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 on hv-cinder-79760 May 27 09:44:12.410157 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-4692830f-f21d-4d79-91aa-9a70dd80f993 req-bc0a4fe1-8119-4099-adc7-7e774a8d5030 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029838 May 27 09:44:12.410740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 311/614] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:44:12.813422 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9a3543ed-95d0-43a3-9e99-7acf99e90b01 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:12.814031 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9a3543ed-95d0-43a3-9e99-7acf99e90b01 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:12.820465 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9a3543ed-95d0-43a3-9e99-7acf99e90b01 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:12.820916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9a3543ed-95d0-43a3-9e99-7acf99e90b01 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:12.821679 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9a3543ed-95d0-43a3-9e99-7acf99e90b01 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:12.822673 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9a3543ed-95d0-43a3-9e99-7acf99e90b01 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:12.874257 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4e99caf9-65ae-4400-9445-d000f6a6d83b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:12.874948 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4e99caf9-65ae-4400-9445-d000f6a6d83b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:12.881241 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e99caf9-65ae-4400-9445-d000f6a6d83b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:12.881697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e99caf9-65ae-4400-9445-d000f6a6d83b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:12.882464 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e99caf9-65ae-4400-9445-d000f6a6d83b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:12.882900 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e99caf9-65ae-4400-9445-d000f6a6d83b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:12.992435 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9a3543ed-95d0-43a3-9e99-7acf99e90b01 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:13.003695 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9a3543ed-95d0-43a3-9e99-7acf99e90b01 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:13.005202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9a3543ed-95d0-43a3-9e99-7acf99e90b01 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:13.006378 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9a3543ed-95d0-43a3-9e99-7acf99e90b01 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1743 microversion: 2.20 time: 0.196870 May 27 09:44:13.006945 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 304/615] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:12 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1743 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:13.028839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c2aeaf82-f66b-4b46-8788-44462ae7bc78 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:13.029356 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c2aeaf82-f66b-4b46-8788-44462ae7bc78 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:13.035378 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c2aeaf82-f66b-4b46-8788-44462ae7bc78 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:13.035846 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c2aeaf82-f66b-4b46-8788-44462ae7bc78 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:13.036624 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c2aeaf82-f66b-4b46-8788-44462ae7bc78 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:13.037034 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c2aeaf82-f66b-4b46-8788-44462ae7bc78 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:13.037345 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4e99caf9-65ae-4400-9445-d000f6a6d83b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:13.045404 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4e99caf9-65ae-4400-9445-d000f6a6d83b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.175802 May 27 09:44:13.045974 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 312/616] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:12 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:44:13.064406 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c2aeaf82-f66b-4b46-8788-44462ae7bc78 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:44:13.135331 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c2aeaf82-f66b-4b46-8788-44462ae7bc78 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 204 len: 0 microversion: 2.1 time: 0.109833 May 27 09:44:13.135901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 305/617] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:44:13 2022] DELETE /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 09:44:13.144212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1a0aac65-ae6b-4151-80da-76bac0a1da6b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:13.144829 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1a0aac65-ae6b-4151-80da-76bac0a1da6b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:13.150684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a0aac65-ae6b-4151-80da-76bac0a1da6b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:13.151126 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a0aac65-ae6b-4151-80da-76bac0a1da6b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:13.151956 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a0aac65-ae6b-4151-80da-76bac0a1da6b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:13.152387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a0aac65-ae6b-4151-80da-76bac0a1da6b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:13.276117 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1a0aac65-ae6b-4151-80da-76bac0a1da6b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:13.283520 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1a0aac65-ae6b-4151-80da-76bac0a1da6b tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1513 microversion: 2.1 time: 0.143245 May 27 09:44:13.284076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 313/618] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:13 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1513 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:14.026127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fe4cb6b1-3692-4602-89d0-68947a10f963 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:14.026819 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-fe4cb6b1-3692-4602-89d0-68947a10f963 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:14.033322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fe4cb6b1-3692-4602-89d0-68947a10f963 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:14.033808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fe4cb6b1-3692-4602-89d0-68947a10f963 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:14.034582 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fe4cb6b1-3692-4602-89d0-68947a10f963 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:14.035020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fe4cb6b1-3692-4602-89d0-68947a10f963 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:14.062430 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f1e66023-66b3-4891-af0a-f94f57453507 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:14.063060 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f1e66023-66b3-4891-af0a-f94f57453507 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:14.069527 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f1e66023-66b3-4891-af0a-f94f57453507 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:14.069972 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f1e66023-66b3-4891-af0a-f94f57453507 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:14.070738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f1e66023-66b3-4891-af0a-f94f57453507 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:14.071169 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f1e66023-66b3-4891-af0a-f94f57453507 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:14.213302 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fe4cb6b1-3692-4602-89d0-68947a10f963 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:14.221547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fe4cb6b1-3692-4602-89d0-68947a10f963 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:14.223062 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fe4cb6b1-3692-4602-89d0-68947a10f963 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:14.224258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fe4cb6b1-3692-4602-89d0-68947a10f963 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1743 microversion: 2.20 time: 0.202378 May 27 09:44:14.224832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 306/619] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:14 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:14.238522 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f1e66023-66b3-4891-af0a-f94f57453507 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:14.246975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f1e66023-66b3-4891-af0a-f94f57453507 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.188464 May 27 09:44:14.247561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 314/620] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:14 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:44:14.300425 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fb0e8daf-93c2-41b2-a30e-cd3aa79ea439 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:14.300977 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-fb0e8daf-93c2-41b2-a30e-cd3aa79ea439 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:14.307553 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb0e8daf-93c2-41b2-a30e-cd3aa79ea439 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:14.308006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb0e8daf-93c2-41b2-a30e-cd3aa79ea439 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:14.308771 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb0e8daf-93c2-41b2-a30e-cd3aa79ea439 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:14.309210 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb0e8daf-93c2-41b2-a30e-cd3aa79ea439 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:14.438207 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fb0e8daf-93c2-41b2-a30e-cd3aa79ea439 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:14.441699 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:14.446597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fb0e8daf-93c2-41b2-a30e-cd3aa79ea439 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1513 microversion: 2.1 time: 0.150015 May 27 09:44:14.447177 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 307/621] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:14 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:15.241873 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-829eb9a3-9e3c-44e7-b0f1-7be377ffe964 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:15.242481 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-829eb9a3-9e3c-44e7-b0f1-7be377ffe964 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:15.248919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-829eb9a3-9e3c-44e7-b0f1-7be377ffe964 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:15.249363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-829eb9a3-9e3c-44e7-b0f1-7be377ffe964 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:15.250110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-829eb9a3-9e3c-44e7-b0f1-7be377ffe964 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:15.250537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-829eb9a3-9e3c-44e7-b0f1-7be377ffe964 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:15.264138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-46ff2ffa-6f2f-4298-b353-4b0d97815cbd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:15.264746 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-46ff2ffa-6f2f-4298-b353-4b0d97815cbd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:15.271914 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-46ff2ffa-6f2f-4298-b353-4b0d97815cbd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:15.272362 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-46ff2ffa-6f2f-4298-b353-4b0d97815cbd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:15.273125 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-46ff2ffa-6f2f-4298-b353-4b0d97815cbd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:15.273562 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-46ff2ffa-6f2f-4298-b353-4b0d97815cbd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:15.446615 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-829eb9a3-9e3c-44e7-b0f1-7be377ffe964 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:15.451096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-46ff2ffa-6f2f-4298-b353-4b0d97815cbd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:15.455123 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-829eb9a3-9e3c-44e7-b0f1-7be377ffe964 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:15.456662 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-829eb9a3-9e3c-44e7-b0f1-7be377ffe964 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:15.457811 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-829eb9a3-9e3c-44e7-b0f1-7be377ffe964 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1743 microversion: 2.20 time: 0.219875 May 27 09:44:15.458363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 315/622] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:15 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:15.459015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-46ff2ffa-6f2f-4298-b353-4b0d97815cbd tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.199736 May 27 09:44:15.459606 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 308/623] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:15 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:44:15.463718 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f081a0da-b2d3-4c66-8932-f7e35c2fb01a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:15.464385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f081a0da-b2d3-4c66-8932-f7e35c2fb01a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:15.470670 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f081a0da-b2d3-4c66-8932-f7e35c2fb01a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:15.471111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f081a0da-b2d3-4c66-8932-f7e35c2fb01a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:15.471889 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f081a0da-b2d3-4c66-8932-f7e35c2fb01a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:15.472321 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f081a0da-b2d3-4c66-8932-f7e35c2fb01a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:15.599071 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f081a0da-b2d3-4c66-8932-f7e35c2fb01a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:15.606543 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f081a0da-b2d3-4c66-8932-f7e35c2fb01a tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1513 microversion: 2.1 time: 0.146282 May 27 09:44:15.607104 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 316/624] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:15 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:16.476210 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2ffdcde4-321b-49fb-8395-7545b60f102f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:16.476755 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b43fcea9-9078-41d4-8e14-05246a4d24e9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:16.477127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2ffdcde4-321b-49fb-8395-7545b60f102f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:16.477234 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b43fcea9-9078-41d4-8e14-05246a4d24e9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:16.483228 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ffdcde4-321b-49fb-8395-7545b60f102f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:16.483396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b43fcea9-9078-41d4-8e14-05246a4d24e9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:16.483716 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ffdcde4-321b-49fb-8395-7545b60f102f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:16.483842 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b43fcea9-9078-41d4-8e14-05246a4d24e9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:16.484515 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ffdcde4-321b-49fb-8395-7545b60f102f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:16.484615 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b43fcea9-9078-41d4-8e14-05246a4d24e9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:16.484971 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b43fcea9-9078-41d4-8e14-05246a4d24e9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:16.485080 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ffdcde4-321b-49fb-8395-7545b60f102f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:16.778588 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2ffdcde4-321b-49fb-8395-7545b60f102f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:16.786677 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b43fcea9-9078-41d4-8e14-05246a4d24e9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:16.786835 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2ffdcde4-321b-49fb-8395-7545b60f102f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:16.788226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2ffdcde4-321b-49fb-8395-7545b60f102f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:16.789636 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2ffdcde4-321b-49fb-8395-7545b60f102f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1743 microversion: 2.20 time: 0.317412 May 27 09:44:16.790356 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 309/625] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:16 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1743 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:16.794958 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0bc68f2b-1fc1-442e-9e93-ee86b257b2b5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:16.795781 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0bc68f2b-1fc1-442e-9e93-ee86b257b2b5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:16.801295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b43fcea9-9078-41d4-8e14-05246a4d24e9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.328898 May 27 09:44:16.801694 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0bc68f2b-1fc1-442e-9e93-ee86b257b2b5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:16.811480 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0bc68f2b-1fc1-442e-9e93-ee86b257b2b5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:16.811700 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 317/626] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:16 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:44:16.811812 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0bc68f2b-1fc1-442e-9e93-ee86b257b2b5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:16.811812 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0bc68f2b-1fc1-442e-9e93-ee86b257b2b5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:17.000919 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0bc68f2b-1fc1-442e-9e93-ee86b257b2b5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e6eb075ba742e68bab4ab79eb37e1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5b7a3a6f5942b49b847f5d9ee9802a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:17.008500 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0bc68f2b-1fc1-442e-9e93-ee86b257b2b5 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 200 len: 1513 microversion: 2.1 time: 0.216969 May 27 09:44:17.009078 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 310/627] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:16 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 1513 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:17.268881 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-08a199ac-1312-4bc6-bb7e-13e03069d275 req-2e408f75-ef84-4926-8aaf-434222f81679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6e5e94-83ef-416e-9663-515180dacccf", "name": "network-vif-deleted", "tag": "df0a58cc-4139-4da1-9076-f302d1e6b031"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:17.277543 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-08a199ac-1312-4bc6-bb7e-13e03069d275 req-2e408f75-ef84-4926-8aaf-434222f81679 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:17.277978 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-08a199ac-1312-4bc6-bb7e-13e03069d275 req-2e408f75-ef84-4926-8aaf-434222f81679 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:17.289135 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-08a199ac-1312-4bc6-bb7e-13e03069d275 req-2e408f75-ef84-4926-8aaf-434222f81679 service nova] Creating event network-vif-deleted:df0a58cc-4139-4da1-9076-f302d1e6b031 for instance ca6e5e94-83ef-416e-9663-515180dacccf on hv-cinder-79760 May 27 09:44:17.294077 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-08a199ac-1312-4bc6-bb7e-13e03069d275 req-2e408f75-ef84-4926-8aaf-434222f81679 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084614 May 27 09:44:17.294714 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 318/628] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:44:17.809349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-070948d1-d23c-4057-b4fc-3a65a76bb2d6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:17.809955 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-070948d1-d23c-4057-b4fc-3a65a76bb2d6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:17.816223 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-070948d1-d23c-4057-b4fc-3a65a76bb2d6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:17.816669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-070948d1-d23c-4057-b4fc-3a65a76bb2d6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:17.817439 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-070948d1-d23c-4057-b4fc-3a65a76bb2d6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:17.817869 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-070948d1-d23c-4057-b4fc-3a65a76bb2d6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:17.820213 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d494c010-5a5b-47dc-8db9-45c42105cb28 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:17.821020 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d494c010-5a5b-47dc-8db9-45c42105cb28 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:17.827986 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d494c010-5a5b-47dc-8db9-45c42105cb28 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:17.828445 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d494c010-5a5b-47dc-8db9-45c42105cb28 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:17.829260 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d494c010-5a5b-47dc-8db9-45c42105cb28 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:17.829704 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d494c010-5a5b-47dc-8db9-45c42105cb28 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:18.034907 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-070948d1-d23c-4057-b4fc-3a65a76bb2d6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:18.039809 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d494c010-5a5b-47dc-8db9-45c42105cb28 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:18.043865 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-070948d1-d23c-4057-b4fc-3a65a76bb2d6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:18.045352 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-070948d1-d23c-4057-b4fc-3a65a76bb2d6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:18.046497 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-070948d1-d23c-4057-b4fc-3a65a76bb2d6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1743 microversion: 2.20 time: 0.242495 May 27 09:44:18.047053 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 311/629] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:17 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:18.051510 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5bf5b94d-c326-48c6-945d-b003b94253f1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:18.052108 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5bf5b94d-c326-48c6-945d-b003b94253f1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] [instance: ca6e5e94-83ef-416e-9663-515180dacccf] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:18.055744 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d494c010-5a5b-47dc-8db9-45c42105cb28 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.240285 May 27 09:44:18.056997 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 319/630] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:17 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:44:18.059007 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5bf5b94d-c326-48c6-945d-b003b94253f1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:18.059530 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5bf5b94d-c326-48c6-945d-b003b94253f1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:18.060345 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5bf5b94d-c326-48c6-945d-b003b94253f1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:18.060783 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5bf5b94d-c326-48c6-945d-b003b94253f1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:18.074179 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-5bf5b94d-c326-48c6-945d-b003b94253f1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] HTTP exception thrown: Instance ca6e5e94-83ef-416e-9663-515180dacccf could not be found. May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5bf5b94d-c326-48c6-945d-b003b94253f1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Request method failure captured: May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf HTTP/1.1 May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJx69AB0-_YlJnxG5L4fQEuO_aVCbf3Y3exI4ayIcBbqVSm79F1zc3ARIxSpNdO56fFZSHDTY86itnc38Oct9_53Y8eRekpW287LHMJWedl3aTxabcl24Iq-PvKEvXxAtTn08vKky_ldKA7OjWYclxOkPbZA7JmQDeOIQlA2l1xvzZ8 May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: fd5b7a3a6f5942b49b847f5d9ee9802a May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-VolumesSnapshotTestJSON-901540710 May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:44:18.075889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fd5b7a3a6f5942b49b847f5d9ee9802a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fd5b7a3a6f5942b49b847f5d9ee9802a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fd5b7a3a6f5942b49b847f5d9ee9802a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fd5b7a3a6f5942b49b847f5d9ee9802a"}]}] May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-VolumesSnapshotTestJSON-901540710 May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: fd5b7a3a6f5942b49b847f5d9ee9802a May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-901540710 May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-VolumesSnapshotTestJSON-901540710-project May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 52e6eb075ba742e68bab4ab79eb37e1d May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-VolumesSnapshotTestJSON-901540710-project May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance ca6e5e94-83ef-416e-9663-515180dacccf could not be found. May 27 09:44:18.077511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'ca6e5e94-83ef-416e-9663-515180dacccf'} May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6e5e94-83ef-416e-9663-515180dacccf could not be found. May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:44:18.078420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6e5e94-83ef-416e-9663-515180dacccf could not be found. May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6e5e94-83ef-416e-9663-515180dacccf could not be found. May 27 09:44:18.079957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:44:18.081266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5bf5b94d-c326-48c6-945d-b003b94253f1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] Returning 404 to user: Instance ca6e5e94-83ef-416e-9663-515180dacccf could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:44:18.081266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5bf5b94d-c326-48c6-945d-b003b94253f1 tempest-VolumesSnapshotTestJSON-901540710 tempest-VolumesSnapshotTestJSON-901540710-project] 10.222.0.41 "GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf" status: 404 len: 111 microversion: 2.1 time: 0.029215 May 27 09:44:18.081266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 312/631] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:18 2022] GET /compute/v2.1/servers/ca6e5e94-83ef-416e-9663-515180dacccf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:44:19.064548 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8c395bc9-0deb-4d29-a81d-d65d14c0392b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:19.065183 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8c395bc9-0deb-4d29-a81d-d65d14c0392b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:19.072312 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8c395bc9-0deb-4d29-a81d-d65d14c0392b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:19.072758 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8c395bc9-0deb-4d29-a81d-d65d14c0392b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:19.073704 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c66e3436-3cc2-458c-b4c8-23aa7c6b8654 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:19.074155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8c395bc9-0deb-4d29-a81d-d65d14c0392b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:19.074155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8c395bc9-0deb-4d29-a81d-d65d14c0392b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:19.074340 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c66e3436-3cc2-458c-b4c8-23aa7c6b8654 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:19.078382 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:19.081220 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c66e3436-3cc2-458c-b4c8-23aa7c6b8654 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:19.081705 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c66e3436-3cc2-458c-b4c8-23aa7c6b8654 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:19.082471 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c66e3436-3cc2-458c-b4c8-23aa7c6b8654 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:19.082908 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c66e3436-3cc2-458c-b4c8-23aa7c6b8654 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:19.278193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8c395bc9-0deb-4d29-a81d-d65d14c0392b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:19.281102 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c66e3436-3cc2-458c-b4c8-23aa7c6b8654 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:19.287860 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8c395bc9-0deb-4d29-a81d-d65d14c0392b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:19.290043 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8c395bc9-0deb-4d29-a81d-d65d14c0392b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:19.291738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8c395bc9-0deb-4d29-a81d-d65d14c0392b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1738 microversion: 2.20 time: 0.231192 May 27 09:44:19.291869 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c66e3436-3cc2-458c-b4c8-23aa7c6b8654 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.221919 May 27 09:44:19.292302 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 320/632] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:19 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:19.302092 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 313/633] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:19 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:44:20.309956 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4ebe8eb5-3bec-4fcc-a832-853311e0479b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:20.310862 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ac394b67-2dff-4925-99b3-da421919a07c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:20.311469 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ac394b67-2dff-4925-99b3-da421919a07c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:20.312264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4ebe8eb5-3bec-4fcc-a832-853311e0479b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:20.318093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ac394b67-2dff-4925-99b3-da421919a07c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:20.318969 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ac394b67-2dff-4925-99b3-da421919a07c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:20.319974 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ac394b67-2dff-4925-99b3-da421919a07c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:20.320605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ac394b67-2dff-4925-99b3-da421919a07c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:20.322725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4ebe8eb5-3bec-4fcc-a832-853311e0479b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:20.323170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4ebe8eb5-3bec-4fcc-a832-853311e0479b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:20.324024 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4ebe8eb5-3bec-4fcc-a832-853311e0479b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:20.324675 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4ebe8eb5-3bec-4fcc-a832-853311e0479b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:20.451248 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:44:20.451889 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Fri May 27 09:44:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f (ip 10.222.0.41) !!! May 27 09:44:20.541728 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ac394b67-2dff-4925-99b3-da421919a07c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:20.554401 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ac394b67-2dff-4925-99b3-da421919a07c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:20.558094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ac394b67-2dff-4925-99b3-da421919a07c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:20.560509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ac394b67-2dff-4925-99b3-da421919a07c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1738 microversion: 2.20 time: 0.254649 May 27 09:44:20.570547 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4ebe8eb5-3bec-4fcc-a832-853311e0479b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:20.575150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 314/634] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:20 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:44:20.580673 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4ebe8eb5-3bec-4fcc-a832-853311e0479b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.274692 May 27 09:44:20.591142 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 321/635] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:20 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:21.580449 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e554c3e6-d140-49da-8506-1073d430fbac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:21.581059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e554c3e6-d140-49da-8506-1073d430fbac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:21.588126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e554c3e6-d140-49da-8506-1073d430fbac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:21.588779 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e554c3e6-d140-49da-8506-1073d430fbac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:21.589763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e554c3e6-d140-49da-8506-1073d430fbac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:21.590494 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e554c3e6-d140-49da-8506-1073d430fbac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:21.598598 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-30e726d7-f717-4358-b741-3aaf14c93617 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:21.599316 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-30e726d7-f717-4358-b741-3aaf14c93617 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:21.605874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-30e726d7-f717-4358-b741-3aaf14c93617 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:21.606862 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-30e726d7-f717-4358-b741-3aaf14c93617 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:21.607875 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-30e726d7-f717-4358-b741-3aaf14c93617 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:21.608549 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-30e726d7-f717-4358-b741-3aaf14c93617 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:21.827622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e554c3e6-d140-49da-8506-1073d430fbac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:21.830764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-30e726d7-f717-4358-b741-3aaf14c93617 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:21.837388 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e554c3e6-d140-49da-8506-1073d430fbac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:21.838782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-30e726d7-f717-4358-b741-3aaf14c93617 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.244377 May 27 09:44:21.849194 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 322/636] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:21 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:44:21.851341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e554c3e6-d140-49da-8506-1073d430fbac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:21.854494 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e554c3e6-d140-49da-8506-1073d430fbac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1738 microversion: 2.20 time: 0.276523 May 27 09:44:21.855165 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 315/637] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:21 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:22.857666 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-120f09bb-46cd-475d-a9e8-14e3a9590070 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:22.859005 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-120f09bb-46cd-475d-a9e8-14e3a9590070 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:22.865884 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-120f09bb-46cd-475d-a9e8-14e3a9590070 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:22.867869 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-120f09bb-46cd-475d-a9e8-14e3a9590070 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:22.869024 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-120f09bb-46cd-475d-a9e8-14e3a9590070 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:22.869666 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-120f09bb-46cd-475d-a9e8-14e3a9590070 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:22.872910 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-928cc2e3-e32b-49b0-8b35-5b4e46a70eb7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:22.873597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-928cc2e3-e32b-49b0-8b35-5b4e46a70eb7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:22.880147 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-928cc2e3-e32b-49b0-8b35-5b4e46a70eb7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:22.880894 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-928cc2e3-e32b-49b0-8b35-5b4e46a70eb7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:22.881920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-928cc2e3-e32b-49b0-8b35-5b4e46a70eb7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:22.882727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-928cc2e3-e32b-49b0-8b35-5b4e46a70eb7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:23.097340 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-120f09bb-46cd-475d-a9e8-14e3a9590070 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:23.106155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-120f09bb-46cd-475d-a9e8-14e3a9590070 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.252882 May 27 09:44:23.106739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 323/638] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:22 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:23.126214 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-928cc2e3-e32b-49b0-8b35-5b4e46a70eb7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:23.134366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-928cc2e3-e32b-49b0-8b35-5b4e46a70eb7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:23.136139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-928cc2e3-e32b-49b0-8b35-5b4e46a70eb7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:23.137493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-928cc2e3-e32b-49b0-8b35-5b4e46a70eb7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1738 microversion: 2.20 time: 0.268681 May 27 09:44:23.138047 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 316/639] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:22 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:24.123977 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0ed0da29-c49a-406b-b4de-049f869b4e60 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:24.124613 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0ed0da29-c49a-406b-b4de-049f869b4e60 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:24.131337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ed0da29-c49a-406b-b4de-049f869b4e60 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:24.132048 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ed0da29-c49a-406b-b4de-049f869b4e60 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:24.132578 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ed0da29-c49a-406b-b4de-049f869b4e60 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:24.133022 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0ed0da29-c49a-406b-b4de-049f869b4e60 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:24.156931 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7f8e6cbc-5840-4a1d-8acd-9df29b5374d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:24.157547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7f8e6cbc-5840-4a1d-8acd-9df29b5374d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:24.164526 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7f8e6cbc-5840-4a1d-8acd-9df29b5374d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:24.165061 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7f8e6cbc-5840-4a1d-8acd-9df29b5374d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:24.166510 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7f8e6cbc-5840-4a1d-8acd-9df29b5374d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:24.167009 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7f8e6cbc-5840-4a1d-8acd-9df29b5374d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:24.334861 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0ed0da29-c49a-406b-b4de-049f869b4e60 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:24.349497 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0ed0da29-c49a-406b-b4de-049f869b4e60 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.229295 May 27 09:44:24.361465 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 324/640] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:24 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:24.368890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7f8e6cbc-5840-4a1d-8acd-9df29b5374d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:24.380629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7f8e6cbc-5840-4a1d-8acd-9df29b5374d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:24.382289 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7f8e6cbc-5840-4a1d-8acd-9df29b5374d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:24.383744 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7f8e6cbc-5840-4a1d-8acd-9df29b5374d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1738 microversion: 2.20 time: 0.231420 May 27 09:44:24.384653 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 317/641] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:24 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:44:25.370069 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e7d7f416-d6d1-4a26-9018-b980a5c8a56c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:25.370801 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e7d7f416-d6d1-4a26-9018-b980a5c8a56c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:25.380718 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e7d7f416-d6d1-4a26-9018-b980a5c8a56c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:25.381265 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e7d7f416-d6d1-4a26-9018-b980a5c8a56c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:25.382225 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e7d7f416-d6d1-4a26-9018-b980a5c8a56c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:25.382844 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e7d7f416-d6d1-4a26-9018-b980a5c8a56c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:25.402099 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-308183a6-1dda-4998-bbff-ba36f7c19546 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:25.402704 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-308183a6-1dda-4998-bbff-ba36f7c19546 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:25.409978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-308183a6-1dda-4998-bbff-ba36f7c19546 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:25.410778 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-308183a6-1dda-4998-bbff-ba36f7c19546 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:25.411818 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-308183a6-1dda-4998-bbff-ba36f7c19546 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:25.412479 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-308183a6-1dda-4998-bbff-ba36f7c19546 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:25.593819 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e7d7f416-d6d1-4a26-9018-b980a5c8a56c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:25.610630 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-308183a6-1dda-4998-bbff-ba36f7c19546 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:25.617940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e7d7f416-d6d1-4a26-9018-b980a5c8a56c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1723 microversion: 2.1 time: 0.252509 May 27 09:44:25.618595 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 325/642] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:25 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:25.623443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-308183a6-1dda-4998-bbff-ba36f7c19546 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:25.625232 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-308183a6-1dda-4998-bbff-ba36f7c19546 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:25.626948 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-308183a6-1dda-4998-bbff-ba36f7c19546 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1738 microversion: 2.20 time: 0.228837 May 27 09:44:25.627773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 318/643] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:25 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:26.637657 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f1706cf3-f423-4224-8f8f-3c04179d830f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:26.638928 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f1706cf3-f423-4224-8f8f-3c04179d830f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:26.645880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f1706cf3-f423-4224-8f8f-3c04179d830f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:26.646337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f1706cf3-f423-4224-8f8f-3c04179d830f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:26.647113 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f1706cf3-f423-4224-8f8f-3c04179d830f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:26.647595 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f1706cf3-f423-4224-8f8f-3c04179d830f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:26.649301 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a47fa73b-1138-4143-8004-85e477e91dc6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:26.651088 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a47fa73b-1138-4143-8004-85e477e91dc6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:26.660013 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a47fa73b-1138-4143-8004-85e477e91dc6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:26.660483 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a47fa73b-1138-4143-8004-85e477e91dc6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:26.661430 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a47fa73b-1138-4143-8004-85e477e91dc6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:26.662142 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a47fa73b-1138-4143-8004-85e477e91dc6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:26.869749 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a47fa73b-1138-4143-8004-85e477e91dc6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:26.881822 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a47fa73b-1138-4143-8004-85e477e91dc6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:26.885693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a47fa73b-1138-4143-8004-85e477e91dc6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:26.889170 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a47fa73b-1138-4143-8004-85e477e91dc6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1738 microversion: 2.20 time: 0.244662 May 27 09:44:26.890812 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 319/644] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:26 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:44:26.899342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f1706cf3-f423-4224-8f8f-3c04179d830f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:26.908671 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f1706cf3-f423-4224-8f8f-3c04179d830f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1700 microversion: 2.1 time: 0.276490 May 27 09:44:26.909609 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 326/645] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:26 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1700 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:26.935237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7b4b9991-3c60-4dbe-bd93-48643ad32b94 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:26.944356 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7b4b9991-3c60-4dbe-bd93-48643ad32b94 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:26.946070 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7b4b9991-3c60-4dbe-bd93-48643ad32b94 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:27.013717 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7b4b9991-3c60-4dbe-bd93-48643ad32b94 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Going to try to start instance {{(pid=129291) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 09:44:27.066203 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7b4b9991-3c60-4dbe-bd93-48643ad32b94 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/action" status: 202 len: 0 microversion: 2.1 time: 0.137469 May 27 09:44:27.067340 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 320/646] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:44:26 2022] POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:44:27.075235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d4f30a5d-c445-48d7-af4c-10088cc825a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:27.076857 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d4f30a5d-c445-48d7-af4c-10088cc825a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:27.089236 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4f30a5d-c445-48d7-af4c-10088cc825a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:27.089992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4f30a5d-c445-48d7-af4c-10088cc825a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:27.090785 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4f30a5d-c445-48d7-af4c-10088cc825a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:27.091240 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4f30a5d-c445-48d7-af4c-10088cc825a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:27.305429 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d4f30a5d-c445-48d7-af4c-10088cc825a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:27.319088 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d4f30a5d-c445-48d7-af4c-10088cc825a5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1709 microversion: 2.1 time: 0.247623 May 27 09:44:27.332834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 327/647] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:27 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1709 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:27.922016 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0b98a492-0215-4393-beb6-db6d37b2e4bc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:27.922826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0b98a492-0215-4393-beb6-db6d37b2e4bc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:27.930370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b98a492-0215-4393-beb6-db6d37b2e4bc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:27.930832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b98a492-0215-4393-beb6-db6d37b2e4bc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:27.932221 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b98a492-0215-4393-beb6-db6d37b2e4bc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:27.932662 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b98a492-0215-4393-beb6-db6d37b2e4bc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:28.102317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0b98a492-0215-4393-beb6-db6d37b2e4bc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:28.112720 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0b98a492-0215-4393-beb6-db6d37b2e4bc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:28.114231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0b98a492-0215-4393-beb6-db6d37b2e4bc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:28.115423 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0b98a492-0215-4393-beb6-db6d37b2e4bc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1738 microversion: 2.20 time: 0.205029 May 27 09:44:28.116163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 321/648] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:27 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:28.340869 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7b871d7d-10ec-4f35-a238-8bf3ffb8b878 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:28.342220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7b871d7d-10ec-4f35-a238-8bf3ffb8b878 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:28.350119 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7b871d7d-10ec-4f35-a238-8bf3ffb8b878 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:28.350904 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7b871d7d-10ec-4f35-a238-8bf3ffb8b878 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:28.352119 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7b871d7d-10ec-4f35-a238-8bf3ffb8b878 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:28.353356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7b871d7d-10ec-4f35-a238-8bf3ffb8b878 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:28.548386 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7b871d7d-10ec-4f35-a238-8bf3ffb8b878 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:28.558562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7b871d7d-10ec-4f35-a238-8bf3ffb8b878 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1709 microversion: 2.1 time: 0.222883 May 27 09:44:28.559142 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 328/649] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:28 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1709 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:29.133770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-985f3f16-71f3-4735-b619-d217ce3080d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:29.135008 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-985f3f16-71f3-4735-b619-d217ce3080d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:29.141482 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-985f3f16-71f3-4735-b619-d217ce3080d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:29.141932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-985f3f16-71f3-4735-b619-d217ce3080d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:29.142699 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-985f3f16-71f3-4735-b619-d217ce3080d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:29.143139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-985f3f16-71f3-4735-b619-d217ce3080d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:29.268607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-985f3f16-71f3-4735-b619-d217ce3080d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:29.276381 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-985f3f16-71f3-4735-b619-d217ce3080d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:29.277876 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-985f3f16-71f3-4735-b619-d217ce3080d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:29.279054 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-985f3f16-71f3-4735-b619-d217ce3080d2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1738 microversion: 2.20 time: 0.149158 May 27 09:44:29.279646 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 322/650] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:29 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:29.575875 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-694c9843-eeaa-4225-8005-81e813f01673 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:29.576525 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-694c9843-eeaa-4225-8005-81e813f01673 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:29.583097 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-694c9843-eeaa-4225-8005-81e813f01673 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:29.583581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-694c9843-eeaa-4225-8005-81e813f01673 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:29.584345 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-694c9843-eeaa-4225-8005-81e813f01673 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:29.584782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-694c9843-eeaa-4225-8005-81e813f01673 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:29.713239 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-694c9843-eeaa-4225-8005-81e813f01673 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:29.722388 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-694c9843-eeaa-4225-8005-81e813f01673 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1713 microversion: 2.1 time: 0.150296 May 27 09:44:29.722984 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 329/651] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:44:29 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:30.297109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c7573387-087c-4d43-bf1c-c6bd9155b3ff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:30.297713 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c7573387-087c-4d43-bf1c-c6bd9155b3ff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:30.304088 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c7573387-087c-4d43-bf1c-c6bd9155b3ff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:30.304531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c7573387-087c-4d43-bf1c-c6bd9155b3ff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:30.305282 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c7573387-087c-4d43-bf1c-c6bd9155b3ff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:30.306206 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c7573387-087c-4d43-bf1c-c6bd9155b3ff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:30.445906 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c7573387-087c-4d43-bf1c-c6bd9155b3ff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:30.454446 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c7573387-087c-4d43-bf1c-c6bd9155b3ff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:30.456038 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c7573387-087c-4d43-bf1c-c6bd9155b3ff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:30.457193 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c7573387-087c-4d43-bf1c-c6bd9155b3ff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1738 microversion: 2.20 time: 0.163967 May 27 09:44:30.457763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 323/652] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:30 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:31.475591 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-3e0edd00-f53d-4ba8-b4ba-a5f253926abb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:31.476219 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3e0edd00-f53d-4ba8-b4ba-a5f253926abb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:31.482599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3e0edd00-f53d-4ba8-b4ba-a5f253926abb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:31.483044 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3e0edd00-f53d-4ba8-b4ba-a5f253926abb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:31.483837 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3e0edd00-f53d-4ba8-b4ba-a5f253926abb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:31.484267 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3e0edd00-f53d-4ba8-b4ba-a5f253926abb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:31.674868 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-3e0edd00-f53d-4ba8-b4ba-a5f253926abb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:31.682977 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-3e0edd00-f53d-4ba8-b4ba-a5f253926abb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:31.684503 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-3e0edd00-f53d-4ba8-b4ba-a5f253926abb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:31.685662 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3e0edd00-f53d-4ba8-b4ba-a5f253926abb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1720 microversion: 2.20 time: 0.213935 May 27 09:44:31.686194 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 330/653] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:31 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:32.704553 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-adb1935a-26cc-43c5-a59e-2ca97822939a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:32.705121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-adb1935a-26cc-43c5-a59e-2ca97822939a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:32.711613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-adb1935a-26cc-43c5-a59e-2ca97822939a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:32.712658 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-adb1935a-26cc-43c5-a59e-2ca97822939a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:32.713425 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-adb1935a-26cc-43c5-a59e-2ca97822939a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:32.713889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-adb1935a-26cc-43c5-a59e-2ca97822939a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:32.718100 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:32.854170 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-adb1935a-26cc-43c5-a59e-2ca97822939a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:32.862209 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-adb1935a-26cc-43c5-a59e-2ca97822939a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:32.863741 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-adb1935a-26cc-43c5-a59e-2ca97822939a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:32.864892 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-adb1935a-26cc-43c5-a59e-2ca97822939a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1720 microversion: 2.20 time: 0.164294 May 27 09:44:32.865465 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 324/654] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:32 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:33.884425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-47441b1a-76f4-44ed-9b87-40cd05013fe4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:33.885032 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-47441b1a-76f4-44ed-9b87-40cd05013fe4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:33.887462 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=56 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:33.892681 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-47441b1a-76f4-44ed-9b87-40cd05013fe4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:33.893127 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-47441b1a-76f4-44ed-9b87-40cd05013fe4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:33.893886 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-47441b1a-76f4-44ed-9b87-40cd05013fe4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:33.894317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-47441b1a-76f4-44ed-9b87-40cd05013fe4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:34.019756 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-47441b1a-76f4-44ed-9b87-40cd05013fe4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:34.030833 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-47441b1a-76f4-44ed-9b87-40cd05013fe4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:34.034414 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-47441b1a-76f4-44ed-9b87-40cd05013fe4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:34.035651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-47441b1a-76f4-44ed-9b87-40cd05013fe4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1720 microversion: 2.20 time: 0.156293 May 27 09:44:34.036207 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 331/655] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:33 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:35.054259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ae336128-4f08-45c7-8000-d9e7dddb0536 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:35.054867 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ae336128-4f08-45c7-8000-d9e7dddb0536 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:35.057680 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:35.063041 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ae336128-4f08-45c7-8000-d9e7dddb0536 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:35.063522 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ae336128-4f08-45c7-8000-d9e7dddb0536 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:35.064302 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ae336128-4f08-45c7-8000-d9e7dddb0536 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:35.064744 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ae336128-4f08-45c7-8000-d9e7dddb0536 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:35.200919 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ae336128-4f08-45c7-8000-d9e7dddb0536 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:35.210814 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ae336128-4f08-45c7-8000-d9e7dddb0536 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:35.212341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ae336128-4f08-45c7-8000-d9e7dddb0536 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:35.213540 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ae336128-4f08-45c7-8000-d9e7dddb0536 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1720 microversion: 2.20 time: 0.163170 May 27 09:44:35.214104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 325/656] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:35 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:35.712326 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-1016cf24-ba51-4030-8d79-702c57fa9064 req-1fe157a6-1e87-4061-bf48-0c2be9593d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7937af8-bbeb-4a70-bd98-1062cbe0d4c7", "name": "network-vif-unplugged", "status": "completed", "tag": "6328b701-4055-487d-8cef-ec0bdfa4ceda"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:35.722459 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-1016cf24-ba51-4030-8d79-702c57fa9064 req-1fe157a6-1e87-4061-bf48-0c2be9593d4f service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:35.722905 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-1016cf24-ba51-4030-8d79-702c57fa9064 req-1fe157a6-1e87-4061-bf48-0c2be9593d4f service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:35.734230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-1016cf24-ba51-4030-8d79-702c57fa9064 req-1fe157a6-1e87-4061-bf48-0c2be9593d4f service nova] Creating event network-vif-unplugged:6328b701-4055-487d-8cef-ec0bdfa4ceda for instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 on hv-cinder-79760 May 27 09:44:35.739143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-1016cf24-ba51-4030-8d79-702c57fa9064 req-1fe157a6-1e87-4061-bf48-0c2be9593d4f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086020 May 27 09:44:35.739758 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 332/657] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:44:36.231711 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a4f2e455-5996-4828-b3fd-38a7f849e782 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:36.232323 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a4f2e455-5996-4828-b3fd-38a7f849e782 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:36.238863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a4f2e455-5996-4828-b3fd-38a7f849e782 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:36.239341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a4f2e455-5996-4828-b3fd-38a7f849e782 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:36.240108 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a4f2e455-5996-4828-b3fd-38a7f849e782 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:36.240546 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a4f2e455-5996-4828-b3fd-38a7f849e782 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:36.367635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a4f2e455-5996-4828-b3fd-38a7f849e782 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:36.376006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a4f2e455-5996-4828-b3fd-38a7f849e782 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:36.377501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a4f2e455-5996-4828-b3fd-38a7f849e782 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:36.378643 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a4f2e455-5996-4828-b3fd-38a7f849e782 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1720 microversion: 2.20 time: 0.150743 May 27 09:44:36.379198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 326/658] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:36 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:37.397686 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7119261f-6a1f-4b82-bc30-4421edf2eb16 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:37.398324 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7119261f-6a1f-4b82-bc30-4421edf2eb16 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:37.405087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7119261f-6a1f-4b82-bc30-4421edf2eb16 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:37.405529 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7119261f-6a1f-4b82-bc30-4421edf2eb16 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:37.406278 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7119261f-6a1f-4b82-bc30-4421edf2eb16 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:37.406709 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7119261f-6a1f-4b82-bc30-4421edf2eb16 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:37.533832 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7119261f-6a1f-4b82-bc30-4421edf2eb16 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:37.541560 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7119261f-6a1f-4b82-bc30-4421edf2eb16 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:37.543053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7119261f-6a1f-4b82-bc30-4421edf2eb16 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:37.544249 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7119261f-6a1f-4b82-bc30-4421edf2eb16 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1720 microversion: 2.20 time: 0.151484 May 27 09:44:37.544799 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 333/659] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:37 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:38.563190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-acf23667-226d-4e5c-99ff-32fe08219344 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:38.563857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-acf23667-226d-4e5c-99ff-32fe08219344 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:38.570858 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-acf23667-226d-4e5c-99ff-32fe08219344 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:38.571314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-acf23667-226d-4e5c-99ff-32fe08219344 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:38.572078 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-acf23667-226d-4e5c-99ff-32fe08219344 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:38.572511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-acf23667-226d-4e5c-99ff-32fe08219344 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:38.861196 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-acf23667-226d-4e5c-99ff-32fe08219344 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:38.869059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-acf23667-226d-4e5c-99ff-32fe08219344 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:38.870593 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-acf23667-226d-4e5c-99ff-32fe08219344 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:38.871803 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-acf23667-226d-4e5c-99ff-32fe08219344 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1663 microversion: 2.20 time: 0.313008 May 27 09:44:38.872357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 327/660] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:38 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1663 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:38.889750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1001ecf1-b2de-4a88-a0e4-1ec33ea3e24d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfc49896-76af-4726-b262-a819a713522a"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:38.890806 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1001ecf1-b2de-4a88-a0e4-1ec33ea3e24d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:38.897266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1001ecf1-b2de-4a88-a0e4-1ec33ea3e24d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:38.897718 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1001ecf1-b2de-4a88-a0e4-1ec33ea3e24d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:38.898476 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1001ecf1-b2de-4a88-a0e4-1ec33ea3e24d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:38.898914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1001ecf1-b2de-4a88-a0e4-1ec33ea3e24d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:39.160705 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:39.167541 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1001ecf1-b2de-4a88-a0e4-1ec33ea3e24d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282228 May 27 09:44:39.168135 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 334/661] 10.222.0.41 () {62 vars in 1363 bytes} [Fri May 27 09:44:38 2022] POST /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:44:39.284584 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-958d061c-d7d3-4961-bd17-77ff3ec17e3d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:39.285157 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-958d061c-d7d3-4961-bd17-77ff3ec17e3d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:39.291075 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-958d061c-d7d3-4961-bd17-77ff3ec17e3d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:39.291560 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-958d061c-d7d3-4961-bd17-77ff3ec17e3d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:39.292325 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-958d061c-d7d3-4961-bd17-77ff3ec17e3d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:39.292769 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-958d061c-d7d3-4961-bd17-77ff3ec17e3d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:39.422669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-958d061c-d7d3-4961-bd17-77ff3ec17e3d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/action" status: 202 len: 0 microversion: 2.20 time: 0.141934 May 27 09:44:39.423253 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 328/662] 10.222.0.41 () {62 vars in 1318 bytes} [Fri May 27 09:44:39 2022] POST /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 09:44:39.431828 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-27fea57b-2a17-4d5d-b151-ea87a4a11efb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:39.432522 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-27fea57b-2a17-4d5d-b151-ea87a4a11efb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:39.440960 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-27fea57b-2a17-4d5d-b151-ea87a4a11efb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:39.441402 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-27fea57b-2a17-4d5d-b151-ea87a4a11efb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:39.442172 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-27fea57b-2a17-4d5d-b151-ea87a4a11efb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:39.442605 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-27fea57b-2a17-4d5d-b151-ea87a4a11efb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:39.578161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-27fea57b-2a17-4d5d-b151-ea87a4a11efb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:39.586536 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-27fea57b-2a17-4d5d-b151-ea87a4a11efb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:39.588083 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-27fea57b-2a17-4d5d-b151-ea87a4a11efb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:39.589235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-27fea57b-2a17-4d5d-b151-ea87a4a11efb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1749 microversion: 2.20 time: 0.161753 May 27 09:44:39.589805 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 335/663] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:39 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:40.609025 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-41881355-4a9c-4d27-b9c2-c3807f5b997d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:40.609629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-41881355-4a9c-4d27-b9c2-c3807f5b997d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:40.615569 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-41881355-4a9c-4d27-b9c2-c3807f5b997d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:40.616015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-41881355-4a9c-4d27-b9c2-c3807f5b997d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:40.616773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-41881355-4a9c-4d27-b9c2-c3807f5b997d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:40.617262 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-41881355-4a9c-4d27-b9c2-c3807f5b997d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:40.750349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-41881355-4a9c-4d27-b9c2-c3807f5b997d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:40.759857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-41881355-4a9c-4d27-b9c2-c3807f5b997d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:40.761420 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-41881355-4a9c-4d27-b9c2-c3807f5b997d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:40.762591 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-41881355-4a9c-4d27-b9c2-c3807f5b997d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1751 microversion: 2.20 time: 0.158512 May 27 09:44:40.763143 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 329/664] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:40 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:41.781424 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-cb520d8d-fbc4-4242-837f-95cb8f2ff3a2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:41.782040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-cb520d8d-fbc4-4242-837f-95cb8f2ff3a2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:41.788500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb520d8d-fbc4-4242-837f-95cb8f2ff3a2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:41.788964 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb520d8d-fbc4-4242-837f-95cb8f2ff3a2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:41.789715 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb520d8d-fbc4-4242-837f-95cb8f2ff3a2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:41.790147 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb520d8d-fbc4-4242-837f-95cb8f2ff3a2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:41.917034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cb520d8d-fbc4-4242-837f-95cb8f2ff3a2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:41.925768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cb520d8d-fbc4-4242-837f-95cb8f2ff3a2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:41.927249 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cb520d8d-fbc4-4242-837f-95cb8f2ff3a2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:41.928405 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-cb520d8d-fbc4-4242-837f-95cb8f2ff3a2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.150913 May 27 09:44:41.928959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 336/665] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:41 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:42.947128 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-041c13ca-a173-4a10-af1b-877cabeba47f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:42.947766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-041c13ca-a173-4a10-af1b-877cabeba47f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:42.957461 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-041c13ca-a173-4a10-af1b-877cabeba47f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:42.957914 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-041c13ca-a173-4a10-af1b-877cabeba47f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:42.958847 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-041c13ca-a173-4a10-af1b-877cabeba47f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:42.959301 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-041c13ca-a173-4a10-af1b-877cabeba47f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:43.148849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-041c13ca-a173-4a10-af1b-877cabeba47f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:43.175655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-041c13ca-a173-4a10-af1b-877cabeba47f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:43.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-041c13ca-a173-4a10-af1b-877cabeba47f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:43.182728 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-041c13ca-a173-4a10-af1b-877cabeba47f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.237286 May 27 09:44:43.183338 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 330/666] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:42 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:44.202539 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ba13e938-2c4f-40ce-98f4-9f9448ea350f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:44.203197 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ba13e938-2c4f-40ce-98f4-9f9448ea350f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:44.212062 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba13e938-2c4f-40ce-98f4-9f9448ea350f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:44.212508 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba13e938-2c4f-40ce-98f4-9f9448ea350f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:44.213280 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba13e938-2c4f-40ce-98f4-9f9448ea350f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:44.213741 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba13e938-2c4f-40ce-98f4-9f9448ea350f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:44.368922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ba13e938-2c4f-40ce-98f4-9f9448ea350f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:44.377602 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ba13e938-2c4f-40ce-98f4-9f9448ea350f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:44.379091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ba13e938-2c4f-40ce-98f4-9f9448ea350f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:44.380288 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ba13e938-2c4f-40ce-98f4-9f9448ea350f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.182380 May 27 09:44:44.381146 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 337/667] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:44 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:45.400568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-63eadfa1-8af4-4a98-91fb-ddcdfc3e0e38 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:45.401685 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-63eadfa1-8af4-4a98-91fb-ddcdfc3e0e38 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:45.408997 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-63eadfa1-8af4-4a98-91fb-ddcdfc3e0e38 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:45.409440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-63eadfa1-8af4-4a98-91fb-ddcdfc3e0e38 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:45.410387 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-63eadfa1-8af4-4a98-91fb-ddcdfc3e0e38 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:45.411840 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-63eadfa1-8af4-4a98-91fb-ddcdfc3e0e38 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:45.556739 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-63eadfa1-8af4-4a98-91fb-ddcdfc3e0e38 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:45.565453 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-63eadfa1-8af4-4a98-91fb-ddcdfc3e0e38 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:45.567198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-63eadfa1-8af4-4a98-91fb-ddcdfc3e0e38 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:45.568923 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-63eadfa1-8af4-4a98-91fb-ddcdfc3e0e38 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.172735 May 27 09:44:45.580404 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 331/668] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:45 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:46.587630 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2b1a1316-2e2e-468a-9184-07c1e8694edd tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:46.588234 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2b1a1316-2e2e-468a-9184-07c1e8694edd tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:46.594712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2b1a1316-2e2e-468a-9184-07c1e8694edd tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:46.595144 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2b1a1316-2e2e-468a-9184-07c1e8694edd tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:46.596115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2b1a1316-2e2e-468a-9184-07c1e8694edd tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:46.596727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2b1a1316-2e2e-468a-9184-07c1e8694edd tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:46.733937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2b1a1316-2e2e-468a-9184-07c1e8694edd tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:46.743267 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2b1a1316-2e2e-468a-9184-07c1e8694edd tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:46.744993 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2b1a1316-2e2e-468a-9184-07c1e8694edd tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:46.746182 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2b1a1316-2e2e-468a-9184-07c1e8694edd tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.162414 May 27 09:44:46.746775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 338/669] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:46 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:47.765580 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9afb5c43-c6bc-4389-ac11-e7b33a5e2641 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:47.767148 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9afb5c43-c6bc-4389-ac11-e7b33a5e2641 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:47.775036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9afb5c43-c6bc-4389-ac11-e7b33a5e2641 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:47.775752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9afb5c43-c6bc-4389-ac11-e7b33a5e2641 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:47.776809 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9afb5c43-c6bc-4389-ac11-e7b33a5e2641 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:47.777251 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9afb5c43-c6bc-4389-ac11-e7b33a5e2641 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:47.963205 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9afb5c43-c6bc-4389-ac11-e7b33a5e2641 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:47.972547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9afb5c43-c6bc-4389-ac11-e7b33a5e2641 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:47.974101 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9afb5c43-c6bc-4389-ac11-e7b33a5e2641 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:47.975567 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9afb5c43-c6bc-4389-ac11-e7b33a5e2641 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.215088 May 27 09:44:47.986381 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 332/670] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:47 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:48.998818 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-166e207c-7d1b-4652-853c-8de1d48158ac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:49.001349 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-166e207c-7d1b-4652-853c-8de1d48158ac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:49.012904 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-166e207c-7d1b-4652-853c-8de1d48158ac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:49.013788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-166e207c-7d1b-4652-853c-8de1d48158ac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:49.015665 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-166e207c-7d1b-4652-853c-8de1d48158ac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:49.016267 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-166e207c-7d1b-4652-853c-8de1d48158ac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:49.194420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-166e207c-7d1b-4652-853c-8de1d48158ac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:49.202825 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-166e207c-7d1b-4652-853c-8de1d48158ac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:49.204590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-166e207c-7d1b-4652-853c-8de1d48158ac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:49.205918 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-166e207c-7d1b-4652-853c-8de1d48158ac tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.215101 May 27 09:44:49.211629 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 339/671] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:48 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:50.226414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-36f66e02-8dbb-4523-86e5-adda80672346 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:50.227063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-36f66e02-8dbb-4523-86e5-adda80672346 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:50.234229 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-36f66e02-8dbb-4523-86e5-adda80672346 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:50.234675 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-36f66e02-8dbb-4523-86e5-adda80672346 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:50.235487 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-36f66e02-8dbb-4523-86e5-adda80672346 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:50.235922 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-36f66e02-8dbb-4523-86e5-adda80672346 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:50.474020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-36f66e02-8dbb-4523-86e5-adda80672346 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:50.484868 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-36f66e02-8dbb-4523-86e5-adda80672346 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:50.488047 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-36f66e02-8dbb-4523-86e5-adda80672346 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:50.489072 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-36f66e02-8dbb-4523-86e5-adda80672346 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.267938 May 27 09:44:50.489853 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 333/672] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:50 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:51.510507 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-dcf97fa5-a0e7-47a5-9254-1ee645d88caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:51.512792 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-dcf97fa5-a0e7-47a5-9254-1ee645d88caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:51.526120 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dcf97fa5-a0e7-47a5-9254-1ee645d88caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:51.526566 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dcf97fa5-a0e7-47a5-9254-1ee645d88caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:51.527386 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dcf97fa5-a0e7-47a5-9254-1ee645d88caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:51.527818 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dcf97fa5-a0e7-47a5-9254-1ee645d88caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:52.018778 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-dcf97fa5-a0e7-47a5-9254-1ee645d88caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:52.042020 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-dcf97fa5-a0e7-47a5-9254-1ee645d88caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:52.043735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-dcf97fa5-a0e7-47a5-9254-1ee645d88caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:52.045222 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-dcf97fa5-a0e7-47a5-9254-1ee645d88caf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.541082 May 27 09:44:52.046262 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 340/673] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:51 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:44:53.064475 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4f9a8dba-a45f-4518-afdc-815aaf9a4b39 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:53.065237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4f9a8dba-a45f-4518-afdc-815aaf9a4b39 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:53.072889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f9a8dba-a45f-4518-afdc-815aaf9a4b39 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:53.073602 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f9a8dba-a45f-4518-afdc-815aaf9a4b39 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:53.074655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f9a8dba-a45f-4518-afdc-815aaf9a4b39 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:53.075859 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f9a8dba-a45f-4518-afdc-815aaf9a4b39 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:53.336845 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4f9a8dba-a45f-4518-afdc-815aaf9a4b39 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:53.354264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4f9a8dba-a45f-4518-afdc-815aaf9a4b39 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:53.356444 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4f9a8dba-a45f-4518-afdc-815aaf9a4b39 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:53.358159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4f9a8dba-a45f-4518-afdc-815aaf9a4b39 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.297680 May 27 09:44:53.360110 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 334/674] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:53 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:54.387075 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5cfe7753-f11e-44e6-9ef4-0083bab466a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:54.393010 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5cfe7753-f11e-44e6-9ef4-0083bab466a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:54.405486 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5cfe7753-f11e-44e6-9ef4-0083bab466a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:54.406260 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5cfe7753-f11e-44e6-9ef4-0083bab466a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:54.407313 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5cfe7753-f11e-44e6-9ef4-0083bab466a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:54.407837 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5cfe7753-f11e-44e6-9ef4-0083bab466a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:54.614175 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5cfe7753-f11e-44e6-9ef4-0083bab466a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:54.628977 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5cfe7753-f11e-44e6-9ef4-0083bab466a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:54.630696 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5cfe7753-f11e-44e6-9ef4-0083bab466a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:54.631923 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5cfe7753-f11e-44e6-9ef4-0083bab466a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.251417 May 27 09:44:54.632489 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 341/675] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:54 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:55.650425 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-df3feb96-677a-49f4-9e6b-63268db399d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:55.651121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-df3feb96-677a-49f4-9e6b-63268db399d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:55.666015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df3feb96-677a-49f4-9e6b-63268db399d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:55.667350 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df3feb96-677a-49f4-9e6b-63268db399d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:55.668661 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df3feb96-677a-49f4-9e6b-63268db399d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:55.683701 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df3feb96-677a-49f4-9e6b-63268db399d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:56.009464 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-df3feb96-677a-49f4-9e6b-63268db399d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:56.020085 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-df3feb96-677a-49f4-9e6b-63268db399d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:56.022344 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-df3feb96-677a-49f4-9e6b-63268db399d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:56.024049 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-df3feb96-677a-49f4-9e6b-63268db399d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.377614 May 27 09:44:56.043150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 335/676] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:55 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:57.041955 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-706ede03-94ea-4d0b-9262-d736133eed00 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:57.042561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-706ede03-94ea-4d0b-9262-d736133eed00 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:57.049547 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-706ede03-94ea-4d0b-9262-d736133eed00 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:57.049993 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-706ede03-94ea-4d0b-9262-d736133eed00 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:57.050757 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-706ede03-94ea-4d0b-9262-d736133eed00 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:57.051186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-706ede03-94ea-4d0b-9262-d736133eed00 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:57.334359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-706ede03-94ea-4d0b-9262-d736133eed00 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:57.346537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-706ede03-94ea-4d0b-9262-d736133eed00 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:57.351859 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-706ede03-94ea-4d0b-9262-d736133eed00 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:57.353077 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-706ede03-94ea-4d0b-9262-d736133eed00 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.314960 May 27 09:44:57.353658 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 342/677] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:57 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:58.373406 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fcfca071-a2ae-44ed-9f32-1904aa0f7f57 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:58.374607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-fcfca071-a2ae-44ed-9f32-1904aa0f7f57 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:58.381642 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fcfca071-a2ae-44ed-9f32-1904aa0f7f57 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:58.382349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fcfca071-a2ae-44ed-9f32-1904aa0f7f57 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:58.383335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fcfca071-a2ae-44ed-9f32-1904aa0f7f57 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:58.383931 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fcfca071-a2ae-44ed-9f32-1904aa0f7f57 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:58.930198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fcfca071-a2ae-44ed-9f32-1904aa0f7f57 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:58.947088 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fcfca071-a2ae-44ed-9f32-1904aa0f7f57 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:58.949781 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fcfca071-a2ae-44ed-9f32-1904aa0f7f57 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:58.952626 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fcfca071-a2ae-44ed-9f32-1904aa0f7f57 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.583478 May 27 09:44:58.953551 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 336/678] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:58 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:59.971900 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bfe40cdc-73fb-4db7-8bf2-0a0ea0c5bab4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:59.972498 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bfe40cdc-73fb-4db7-8bf2-0a0ea0c5bab4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:59.994982 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bfe40cdc-73fb-4db7-8bf2-0a0ea0c5bab4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:59.995731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bfe40cdc-73fb-4db7-8bf2-0a0ea0c5bab4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:59.996725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bfe40cdc-73fb-4db7-8bf2-0a0ea0c5bab4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:59.998012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bfe40cdc-73fb-4db7-8bf2-0a0ea0c5bab4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:00.276192 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bfe40cdc-73fb-4db7-8bf2-0a0ea0c5bab4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:00.285877 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bfe40cdc-73fb-4db7-8bf2-0a0ea0c5bab4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:00.287453 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bfe40cdc-73fb-4db7-8bf2-0a0ea0c5bab4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:00.288650 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bfe40cdc-73fb-4db7-8bf2-0a0ea0c5bab4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.321382 May 27 09:45:00.289550 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 343/679] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:44:59 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:00.830115 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3f6cf28d-a563-420f-b653-fafbae378d13 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Action: 'create', calling method: .version_select at 0x7f1890ba25e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-304498852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlCHEUCEPInHhY0BMJXAzYi461gbJIJRI9iT2GxcvrUfWFkthnVInHY2LTbS+1P+h02jyvpbhMrWayOGqsKKYNRAaiJaUJxAPEohS42NofKNfttx5HKPcsoBispvF1zGw=="}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:00.849172 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-3f6cf28d-a563-420f-b653-fafbae378d13 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Getting quotas for project 2ed0733b1ce342f2a6ecac960523f85f. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:45:00.853098 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-3f6cf28d-a563-420f-b653-fafbae378d13 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Getting quotas for user 5b1a972ace154e93aeb19a53930fd306 and project 2ed0733b1ce342f2a6ecac960523f85f. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:45:00.889029 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3f6cf28d-a563-420f-b653-fafbae378d13 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.228581 May 27 09:45:00.889629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 337/680] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 09:45:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:01.307874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6e7f8d97-2200-4ac7-9fdf-63fe5921de3f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:01.308497 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6e7f8d97-2200-4ac7-9fdf-63fe5921de3f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:01.321134 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6e7f8d97-2200-4ac7-9fdf-63fe5921de3f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:01.321589 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6e7f8d97-2200-4ac7-9fdf-63fe5921de3f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:01.322381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6e7f8d97-2200-4ac7-9fdf-63fe5921de3f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:01.322823 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6e7f8d97-2200-4ac7-9fdf-63fe5921de3f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:01.585989 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6e7f8d97-2200-4ac7-9fdf-63fe5921de3f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:01.605506 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6e7f8d97-2200-4ac7-9fdf-63fe5921de3f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:01.608622 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6e7f8d97-2200-4ac7-9fdf-63fe5921de3f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:01.610920 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6e7f8d97-2200-4ac7-9fdf-63fe5921de3f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.306538 May 27 09:45:01.611694 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 344/681] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:01 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:02.631406 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e96fb827-353b-4b1a-a1c8-538d7d68090b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:02.632233 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e96fb827-353b-4b1a-a1c8-538d7d68090b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:02.639431 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e96fb827-353b-4b1a-a1c8-538d7d68090b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:02.640253 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e96fb827-353b-4b1a-a1c8-538d7d68090b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:02.641145 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e96fb827-353b-4b1a-a1c8-538d7d68090b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:02.641720 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e96fb827-353b-4b1a-a1c8-538d7d68090b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:02.821726 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e96fb827-353b-4b1a-a1c8-538d7d68090b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:02.824122 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:02.833133 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e96fb827-353b-4b1a-a1c8-538d7d68090b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:02.834752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e96fb827-353b-4b1a-a1c8-538d7d68090b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:02.836055 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e96fb827-353b-4b1a-a1c8-538d7d68090b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.209968 May 27 09:45:02.836710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 338/682] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:02 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:03.856754 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-164b1fb5-7f90-419c-a7f2-133e56f40f7f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:03.858186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-164b1fb5-7f90-419c-a7f2-133e56f40f7f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:03.868533 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-164b1fb5-7f90-419c-a7f2-133e56f40f7f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:03.869170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-164b1fb5-7f90-419c-a7f2-133e56f40f7f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:03.870280 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-164b1fb5-7f90-419c-a7f2-133e56f40f7f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:03.870898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-164b1fb5-7f90-419c-a7f2-133e56f40f7f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:04.040383 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-164b1fb5-7f90-419c-a7f2-133e56f40f7f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:04.055898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-164b1fb5-7f90-419c-a7f2-133e56f40f7f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:04.057942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-164b1fb5-7f90-419c-a7f2-133e56f40f7f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:04.059511 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-164b1fb5-7f90-419c-a7f2-133e56f40f7f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.207785 May 27 09:45:04.060138 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 345/683] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:03 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:04.511889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-482afbe3-4234-4ccc-9e72-db9240922657 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:04.512987 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-482afbe3-4234-4ccc-9e72-db9240922657 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:04.520481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-482afbe3-4234-4ccc-9e72-db9240922657 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:04.521323 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-482afbe3-4234-4ccc-9e72-db9240922657 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:04.522188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-482afbe3-4234-4ccc-9e72-db9240922657 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:04.522929 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-482afbe3-4234-4ccc-9e72-db9240922657 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:04.624259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-482afbe3-4234-4ccc-9e72-db9240922657 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "POST /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/action" status: 202 len: 0 microversion: 2.1 time: 0.116984 May 27 09:45:04.625098 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 339/684] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:45:04 2022] POST /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:45:04.635001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-73bfccb6-d367-4781-92f0-85828ffa5e94 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:04.635654 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-73bfccb6-d367-4781-92f0-85828ffa5e94 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:04.637753 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=30 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:04.648343 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73bfccb6-d367-4781-92f0-85828ffa5e94 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:04.648712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73bfccb6-d367-4781-92f0-85828ffa5e94 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:04.652029 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73bfccb6-d367-4781-92f0-85828ffa5e94 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:04.652491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73bfccb6-d367-4781-92f0-85828ffa5e94 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:04.918092 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-73bfccb6-d367-4781-92f0-85828ffa5e94 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:04.927089 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-73bfccb6-d367-4781-92f0-85828ffa5e94 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1753 microversion: 2.1 time: 0.297540 May 27 09:45:04.927743 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 346/685] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:04 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1753 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:05.084370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d338faa8-841b-4e71-b898-f35a8d814eaa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:05.085104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d338faa8-841b-4e71-b898-f35a8d814eaa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:05.087019 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:05.093547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d338faa8-841b-4e71-b898-f35a8d814eaa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:05.094014 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d338faa8-841b-4e71-b898-f35a8d814eaa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:05.094836 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d338faa8-841b-4e71-b898-f35a8d814eaa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:05.095334 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d338faa8-841b-4e71-b898-f35a8d814eaa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:05.324160 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d338faa8-841b-4e71-b898-f35a8d814eaa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:05.333341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d338faa8-841b-4e71-b898-f35a8d814eaa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:05.335040 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d338faa8-841b-4e71-b898-f35a8d814eaa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:05.336369 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d338faa8-841b-4e71-b898-f35a8d814eaa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.256285 May 27 09:45:05.337032 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 340/686] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:05 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:05.948155 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6b42e4b7-645e-4c0f-b711-d96bdcdb23b3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:05.949627 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6b42e4b7-645e-4c0f-b711-d96bdcdb23b3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:05.957224 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6b42e4b7-645e-4c0f-b711-d96bdcdb23b3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:05.957775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6b42e4b7-645e-4c0f-b711-d96bdcdb23b3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:05.958682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6b42e4b7-645e-4c0f-b711-d96bdcdb23b3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:05.959108 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6b42e4b7-645e-4c0f-b711-d96bdcdb23b3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:06.109248 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6b42e4b7-645e-4c0f-b711-d96bdcdb23b3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:06.117822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6b42e4b7-645e-4c0f-b711-d96bdcdb23b3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.177312 May 27 09:45:06.118389 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 347/687] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:05 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:06.356796 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-aa08e0b5-697b-4531-b436-63dbfbbcdef9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:06.357318 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-aa08e0b5-697b-4531-b436-63dbfbbcdef9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:06.363829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aa08e0b5-697b-4531-b436-63dbfbbcdef9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:06.364282 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aa08e0b5-697b-4531-b436-63dbfbbcdef9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:06.365045 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aa08e0b5-697b-4531-b436-63dbfbbcdef9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:06.365480 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aa08e0b5-697b-4531-b436-63dbfbbcdef9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:06.495254 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-aa08e0b5-697b-4531-b436-63dbfbbcdef9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:06.503685 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-aa08e0b5-697b-4531-b436-63dbfbbcdef9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:06.505193 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-aa08e0b5-697b-4531-b436-63dbfbbcdef9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:06.506378 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-aa08e0b5-697b-4531-b436-63dbfbbcdef9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.154221 May 27 09:45:06.506944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 341/688] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:06 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:07.134859 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7639f4a4-2859-41c2-903a-03d91667d8a3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:07.135528 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7639f4a4-2859-41c2-903a-03d91667d8a3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:07.142619 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7639f4a4-2859-41c2-903a-03d91667d8a3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:07.143065 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7639f4a4-2859-41c2-903a-03d91667d8a3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:07.143881 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7639f4a4-2859-41c2-903a-03d91667d8a3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:07.144318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7639f4a4-2859-41c2-903a-03d91667d8a3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:07.306084 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7639f4a4-2859-41c2-903a-03d91667d8a3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:07.314509 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7639f4a4-2859-41c2-903a-03d91667d8a3 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.183578 May 27 09:45:07.315069 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 348/689] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:07 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:07.524894 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-42636b78-35b7-4d3b-89a4-ab1563dcc592 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:07.525495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-42636b78-35b7-4d3b-89a4-ab1563dcc592 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:07.531493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-42636b78-35b7-4d3b-89a4-ab1563dcc592 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:07.531938 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-42636b78-35b7-4d3b-89a4-ab1563dcc592 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:07.532692 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-42636b78-35b7-4d3b-89a4-ab1563dcc592 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:07.533123 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-42636b78-35b7-4d3b-89a4-ab1563dcc592 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:07.662706 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-42636b78-35b7-4d3b-89a4-ab1563dcc592 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:07.671243 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-42636b78-35b7-4d3b-89a4-ab1563dcc592 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:07.672824 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-42636b78-35b7-4d3b-89a4-ab1563dcc592 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:07.674006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-42636b78-35b7-4d3b-89a4-ab1563dcc592 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.153263 May 27 09:45:07.674570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 342/690] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:07 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:08.333082 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-539b4e0b-c145-456a-9a85-d8576b6e6e6a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:08.333698 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-539b4e0b-c145-456a-9a85-d8576b6e6e6a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:08.340185 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-539b4e0b-c145-456a-9a85-d8576b6e6e6a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:08.340622 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-539b4e0b-c145-456a-9a85-d8576b6e6e6a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:08.341386 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-539b4e0b-c145-456a-9a85-d8576b6e6e6a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:08.341824 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-539b4e0b-c145-456a-9a85-d8576b6e6e6a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:08.490744 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-539b4e0b-c145-456a-9a85-d8576b6e6e6a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:08.498647 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-539b4e0b-c145-456a-9a85-d8576b6e6e6a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.169416 May 27 09:45:08.499216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 349/691] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:08 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:45:08.692778 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cf5c0b92-6411-48a8-bba9-4293af2097ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:08.693312 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cf5c0b92-6411-48a8-bba9-4293af2097ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:08.699838 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf5c0b92-6411-48a8-bba9-4293af2097ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:08.700312 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf5c0b92-6411-48a8-bba9-4293af2097ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:08.701064 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf5c0b92-6411-48a8-bba9-4293af2097ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:08.701498 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf5c0b92-6411-48a8-bba9-4293af2097ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:08.831582 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cf5c0b92-6411-48a8-bba9-4293af2097ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:08.840137 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cf5c0b92-6411-48a8-bba9-4293af2097ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:08.842500 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cf5c0b92-6411-48a8-bba9-4293af2097ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:08.843658 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cf5c0b92-6411-48a8-bba9-4293af2097ee tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.154809 May 27 09:45:08.844217 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 343/692] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:08 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:09.516295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2db504a7-51fe-4add-be1c-79738b9403ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:09.516908 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2db504a7-51fe-4add-be1c-79738b9403ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:09.523298 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2db504a7-51fe-4add-be1c-79738b9403ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:09.523742 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2db504a7-51fe-4add-be1c-79738b9403ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:09.524491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2db504a7-51fe-4add-be1c-79738b9403ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:09.524921 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2db504a7-51fe-4add-be1c-79738b9403ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:09.527400 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=91 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:09.680124 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2db504a7-51fe-4add-be1c-79738b9403ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:09.688124 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2db504a7-51fe-4add-be1c-79738b9403ca tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.176985 May 27 09:45:09.688690 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 350/693] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:09 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:09.862048 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-df099877-82ab-4d19-b946-5ae7c85b17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:09.862603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-df099877-82ab-4d19-b946-5ae7c85b17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:09.869185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df099877-82ab-4d19-b946-5ae7c85b17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:09.869638 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df099877-82ab-4d19-b946-5ae7c85b17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:09.870413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df099877-82ab-4d19-b946-5ae7c85b17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:09.870855 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-df099877-82ab-4d19-b946-5ae7c85b17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:10.000550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-df099877-82ab-4d19-b946-5ae7c85b17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:10.009219 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-df099877-82ab-4d19-b946-5ae7c85b17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:10.010796 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-df099877-82ab-4d19-b946-5ae7c85b17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:10.012065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-df099877-82ab-4d19-b946-5ae7c85b17d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.153986 May 27 09:45:10.012639 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 344/694] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:09 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:10.707391 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-901ae052-2524-46f4-b430-f076054af88a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:10.708002 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-901ae052-2524-46f4-b430-f076054af88a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:10.714572 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-901ae052-2524-46f4-b430-f076054af88a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:10.715016 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-901ae052-2524-46f4-b430-f076054af88a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:10.715805 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-901ae052-2524-46f4-b430-f076054af88a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:10.716239 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-901ae052-2524-46f4-b430-f076054af88a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:10.858858 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-901ae052-2524-46f4-b430-f076054af88a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:10.867931 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-901ae052-2524-46f4-b430-f076054af88a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.164703 May 27 09:45:10.868493 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 351/695] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:10 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:11.029881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5e6e8eb3-2f5e-4420-8a72-4ad16f5bc573 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:11.030487 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5e6e8eb3-2f5e-4420-8a72-4ad16f5bc573 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:11.032981 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=4 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:11.038858 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5e6e8eb3-2f5e-4420-8a72-4ad16f5bc573 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:11.039344 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5e6e8eb3-2f5e-4420-8a72-4ad16f5bc573 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:11.040118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5e6e8eb3-2f5e-4420-8a72-4ad16f5bc573 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:11.040662 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5e6e8eb3-2f5e-4420-8a72-4ad16f5bc573 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:11.184878 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5e6e8eb3-2f5e-4420-8a72-4ad16f5bc573 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:11.194106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5e6e8eb3-2f5e-4420-8a72-4ad16f5bc573 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:11.195667 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5e6e8eb3-2f5e-4420-8a72-4ad16f5bc573 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:11.196825 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5e6e8eb3-2f5e-4420-8a72-4ad16f5bc573 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.170829 May 27 09:45:11.197379 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 345/696] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:11 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:11.682759 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-b4302509-1947-46a3-8065-3e56a1ad4c52 req-e64bcf5a-ddfc-4357-a037-3563d7686600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7937af8-bbeb-4a70-bd98-1062cbe0d4c7", "name": "network-vif-plugged", "status": "completed", "tag": "6328b701-4055-487d-8cef-ec0bdfa4ceda"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:11.691470 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-b4302509-1947-46a3-8065-3e56a1ad4c52 req-e64bcf5a-ddfc-4357-a037-3563d7686600 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:11.691920 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-b4302509-1947-46a3-8065-3e56a1ad4c52 req-e64bcf5a-ddfc-4357-a037-3563d7686600 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:11.704088 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-b4302509-1947-46a3-8065-3e56a1ad4c52 req-e64bcf5a-ddfc-4357-a037-3563d7686600 service nova] Creating event network-vif-plugged:6328b701-4055-487d-8cef-ec0bdfa4ceda for instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 on hv-cinder-79760 May 27 09:45:11.709309 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-b4302509-1947-46a3-8065-3e56a1ad4c52 req-e64bcf5a-ddfc-4357-a037-3563d7686600 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030291 May 27 09:45:11.709990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 352/697] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:11.885203 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3f3c7732-addc-403f-8371-0df2c02483dd tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:11.885741 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-3f3c7732-addc-403f-8371-0df2c02483dd tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:11.891763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3f3c7732-addc-403f-8371-0df2c02483dd tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:11.892214 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3f3c7732-addc-403f-8371-0df2c02483dd tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:11.893995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3f3c7732-addc-403f-8371-0df2c02483dd tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:11.893995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3f3c7732-addc-403f-8371-0df2c02483dd tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:12.040633 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-3f3c7732-addc-403f-8371-0df2c02483dd tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:12.049335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3f3c7732-addc-403f-8371-0df2c02483dd tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.168115 May 27 09:45:12.049910 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 346/698] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:11 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:12.216573 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0899f93f-2b62-490b-a411-fa0d56f54594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:12.217667 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0899f93f-2b62-490b-a411-fa0d56f54594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:12.225021 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0899f93f-2b62-490b-a411-fa0d56f54594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:12.225468 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0899f93f-2b62-490b-a411-fa0d56f54594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:12.226243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0899f93f-2b62-490b-a411-fa0d56f54594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:12.226785 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0899f93f-2b62-490b-a411-fa0d56f54594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:12.406737 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0899f93f-2b62-490b-a411-fa0d56f54594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:12.416206 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0899f93f-2b62-490b-a411-fa0d56f54594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:12.417626 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0899f93f-2b62-490b-a411-fa0d56f54594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:12.418831 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0899f93f-2b62-490b-a411-fa0d56f54594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.206813 May 27 09:45:12.419417 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 353/699] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:12 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:13.067025 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cf065f65-37d0-493b-89db-fd3658e0947c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:13.067689 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cf065f65-37d0-493b-89db-fd3658e0947c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:13.074397 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf065f65-37d0-493b-89db-fd3658e0947c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:13.074843 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf065f65-37d0-493b-89db-fd3658e0947c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:13.075639 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf065f65-37d0-493b-89db-fd3658e0947c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:13.076082 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf065f65-37d0-493b-89db-fd3658e0947c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:13.223578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cf065f65-37d0-493b-89db-fd3658e0947c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:13.231967 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cf065f65-37d0-493b-89db-fd3658e0947c tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.168872 May 27 09:45:13.232540 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 347/700] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:13 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:13.436772 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-72ea2cb4-9698-4f3e-9c0d-2100d6bc4919 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:13.437876 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-72ea2cb4-9698-4f3e-9c0d-2100d6bc4919 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:13.444290 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72ea2cb4-9698-4f3e-9c0d-2100d6bc4919 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:13.444735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72ea2cb4-9698-4f3e-9c0d-2100d6bc4919 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:13.445484 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72ea2cb4-9698-4f3e-9c0d-2100d6bc4919 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:13.445910 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72ea2cb4-9698-4f3e-9c0d-2100d6bc4919 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:13.793367 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-72ea2cb4-9698-4f3e-9c0d-2100d6bc4919 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:13.802342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-72ea2cb4-9698-4f3e-9c0d-2100d6bc4919 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:13.803918 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-72ea2cb4-9698-4f3e-9c0d-2100d6bc4919 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:13.805067 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-72ea2cb4-9698-4f3e-9c0d-2100d6bc4919 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.372191 May 27 09:45:13.805630 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 354/701] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:13 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:14.249226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a32d6f2a-80da-4a26-9583-304ecfeef415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:14.249843 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a32d6f2a-80da-4a26-9583-304ecfeef415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:14.256418 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a32d6f2a-80da-4a26-9583-304ecfeef415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:14.256867 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a32d6f2a-80da-4a26-9583-304ecfeef415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:14.257631 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a32d6f2a-80da-4a26-9583-304ecfeef415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:14.258066 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a32d6f2a-80da-4a26-9583-304ecfeef415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:14.404285 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a32d6f2a-80da-4a26-9583-304ecfeef415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:14.412324 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a32d6f2a-80da-4a26-9583-304ecfeef415 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.167041 May 27 09:45:14.412892 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 348/702] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:14 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:14.823628 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-31c34665-fc7d-43f4-a830-9a9049b14111 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:14.824266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-31c34665-fc7d-43f4-a830-9a9049b14111 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:14.831592 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-31c34665-fc7d-43f4-a830-9a9049b14111 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:14.832042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-31c34665-fc7d-43f4-a830-9a9049b14111 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:14.832812 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-31c34665-fc7d-43f4-a830-9a9049b14111 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:14.833245 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-31c34665-fc7d-43f4-a830-9a9049b14111 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:14.970445 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-31c34665-fc7d-43f4-a830-9a9049b14111 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:14.979086 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-31c34665-fc7d-43f4-a830-9a9049b14111 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:14.980677 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-31c34665-fc7d-43f4-a830-9a9049b14111 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:14.982085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-31c34665-fc7d-43f4-a830-9a9049b14111 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1807 microversion: 2.20 time: 0.162701 May 27 09:45:14.982713 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 355/703] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:14 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:15.429485 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f4c64527-4b41-4c6e-9950-5703d3f9a62f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:15.430099 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f4c64527-4b41-4c6e-9950-5703d3f9a62f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:15.437711 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4c64527-4b41-4c6e-9950-5703d3f9a62f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:15.438250 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4c64527-4b41-4c6e-9950-5703d3f9a62f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:15.439154 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4c64527-4b41-4c6e-9950-5703d3f9a62f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:15.439714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4c64527-4b41-4c6e-9950-5703d3f9a62f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:15.584417 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f4c64527-4b41-4c6e-9950-5703d3f9a62f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:15.594248 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f4c64527-4b41-4c6e-9950-5703d3f9a62f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.168667 May 27 09:45:15.594821 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 349/704] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:15 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:16.002816 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-73fc45a4-6bcf-4614-a474-f4b39c592538 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:16.003364 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-73fc45a4-6bcf-4614-a474-f4b39c592538 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:16.009822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73fc45a4-6bcf-4614-a474-f4b39c592538 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:16.010278 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73fc45a4-6bcf-4614-a474-f4b39c592538 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:16.011045 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73fc45a4-6bcf-4614-a474-f4b39c592538 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:16.011517 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-73fc45a4-6bcf-4614-a474-f4b39c592538 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:16.135831 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-73fc45a4-6bcf-4614-a474-f4b39c592538 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:16.144664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-73fc45a4-6bcf-4614-a474-f4b39c592538 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:16.146149 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-73fc45a4-6bcf-4614-a474-f4b39c592538 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:16.147307 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-73fc45a4-6bcf-4614-a474-f4b39c592538 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1794 microversion: 2.20 time: 0.148978 May 27 09:45:16.147852 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 356/705] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:45:15 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1794 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:16.611919 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4fb576ec-c0f0-4064-8e76-5a0ae9e7cd3a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:16.612580 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4fb576ec-c0f0-4064-8e76-5a0ae9e7cd3a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:16.618913 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4fb576ec-c0f0-4064-8e76-5a0ae9e7cd3a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:16.619392 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4fb576ec-c0f0-4064-8e76-5a0ae9e7cd3a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:16.620152 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4fb576ec-c0f0-4064-8e76-5a0ae9e7cd3a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:16.620583 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4fb576ec-c0f0-4064-8e76-5a0ae9e7cd3a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:16.757508 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4fb576ec-c0f0-4064-8e76-5a0ae9e7cd3a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:16.765383 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4fb576ec-c0f0-4064-8e76-5a0ae9e7cd3a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.157881 May 27 09:45:16.765942 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 350/706] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:16 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:17.781973 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b9fa7433-9bd5-46d8-8917-b305998def47 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:17.782587 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b9fa7433-9bd5-46d8-8917-b305998def47 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:17.788682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b9fa7433-9bd5-46d8-8917-b305998def47 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:17.789128 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b9fa7433-9bd5-46d8-8917-b305998def47 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:17.789890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b9fa7433-9bd5-46d8-8917-b305998def47 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:17.790329 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b9fa7433-9bd5-46d8-8917-b305998def47 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:17.933203 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b9fa7433-9bd5-46d8-8917-b305998def47 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:17.941574 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b9fa7433-9bd5-46d8-8917-b305998def47 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.163601 May 27 09:45:17.942139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 357/707] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:17 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:18.958480 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6665ba5c-7c45-4164-a515-2c9ac2df230b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:18.959087 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6665ba5c-7c45-4164-a515-2c9ac2df230b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:18.965561 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6665ba5c-7c45-4164-a515-2c9ac2df230b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:18.966002 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6665ba5c-7c45-4164-a515-2c9ac2df230b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:18.966758 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6665ba5c-7c45-4164-a515-2c9ac2df230b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:18.967482 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6665ba5c-7c45-4164-a515-2c9ac2df230b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:19.109870 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6665ba5c-7c45-4164-a515-2c9ac2df230b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:19.117745 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6665ba5c-7c45-4164-a515-2c9ac2df230b tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.163260 May 27 09:45:19.118299 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 351/708] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:18 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:20.134196 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ebdc54bb-00e6-48eb-bd7e-cb12d5526c9e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:20.134834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ebdc54bb-00e6-48eb-bd7e-cb12d5526c9e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:20.141858 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ebdc54bb-00e6-48eb-bd7e-cb12d5526c9e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:20.142298 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ebdc54bb-00e6-48eb-bd7e-cb12d5526c9e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:20.143050 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ebdc54bb-00e6-48eb-bd7e-cb12d5526c9e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:20.143518 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ebdc54bb-00e6-48eb-bd7e-cb12d5526c9e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:20.284747 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ebdc54bb-00e6-48eb-bd7e-cb12d5526c9e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:20.292580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ebdc54bb-00e6-48eb-bd7e-cb12d5526c9e tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.162218 May 27 09:45:20.293142 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 358/709] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:20 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:21.309597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5927d2d9-6529-4a49-bd20-772142cbd238 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:21.310263 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5927d2d9-6529-4a49-bd20-772142cbd238 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:21.316808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5927d2d9-6529-4a49-bd20-772142cbd238 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:21.317202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5927d2d9-6529-4a49-bd20-772142cbd238 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:21.317959 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5927d2d9-6529-4a49-bd20-772142cbd238 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:21.318394 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5927d2d9-6529-4a49-bd20-772142cbd238 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:21.459909 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5927d2d9-6529-4a49-bd20-772142cbd238 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:21.468687 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5927d2d9-6529-4a49-bd20-772142cbd238 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1758 microversion: 2.1 time: 0.162979 May 27 09:45:21.469258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 352/710] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:21 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:22.485019 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ad80c974-830d-47d6-bfb5-c249a1359491 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:22.485630 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ad80c974-830d-47d6-bfb5-c249a1359491 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:22.492276 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ad80c974-830d-47d6-bfb5-c249a1359491 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:22.492717 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ad80c974-830d-47d6-bfb5-c249a1359491 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:22.493472 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ad80c974-830d-47d6-bfb5-c249a1359491 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:22.493899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ad80c974-830d-47d6-bfb5-c249a1359491 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:22.635706 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ad80c974-830d-47d6-bfb5-c249a1359491 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:22.644231 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ad80c974-830d-47d6-bfb5-c249a1359491 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1761 microversion: 2.1 time: 0.163082 May 27 09:45:22.644971 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 359/711] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:22 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1761 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:26.900644 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1905046924", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-304498852", "security_groups": [{"name": "tempest-secgroup-smoke-1046363434"}], "networks": [{"uuid": "8f540350-1801-4f76-8904-a6a8b323f8eb"}], "block_device_mapping_v2": [{"uuid": "2e24493b-b48e-4a8b-84be-d46619fe1252", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:27.026064 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.network.neutron [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] validate_networks() for [('8f540350-1801-4f76-8904-a6a8b323f8eb', None, None, None, None, None)] {{(pid=129291) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:45:27.390140 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Flavor limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:45:27.390565 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Image limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:45:27.391041 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Flavor pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:45:27.391490 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Image pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:45:27.391906 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:45:27.401807 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:27.402260 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:27.403059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:27.403542 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:27.420094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Getting quotas for project 2ed0733b1ce342f2a6ecac960523f85f. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:45:27.424191 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Getting quotas for user 5b1a972ace154e93aeb19a53930fd306 and project 2ed0733b1ce342f2a6ecac960523f85f. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:45:27.480183 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Going to run 1 instances... {{(pid=129291) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:45:27.482264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e24493b-b48e-4a8b-84be-d46619fe1252',volume_size=None,volume_type=None)] {{(pid=129291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:45:27.605141 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1d7f9d86-b235-4bd6-82cc-21f55b714518 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708302 May 27 09:45:27.605775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 353/712] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:45:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:45:27.616372 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c1f377e9-c3bb-45cb-852b-80c48d654d98 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:27.616968 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c1f377e9-c3bb-45cb-852b-80c48d654d98 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:27.670492 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c1f377e9-c3bb-45cb-852b-80c48d654d98 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:27.677855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c1f377e9-c3bb-45cb-852b-80c48d654d98 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1088 microversion: 2.1 time: 0.065242 May 27 09:45:27.678728 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 360/713] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:27 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:28.695984 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8456884b-ddda-45bb-9349-a27b379170fd tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:28.697306 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8456884b-ddda-45bb-9349-a27b379170fd tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:28.705233 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8456884b-ddda-45bb-9349-a27b379170fd tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:28.705953 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8456884b-ddda-45bb-9349-a27b379170fd tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:28.706731 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8456884b-ddda-45bb-9349-a27b379170fd tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:28.707369 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8456884b-ddda-45bb-9349-a27b379170fd tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:28.779754 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8456884b-ddda-45bb-9349-a27b379170fd tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:28.787394 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8456884b-ddda-45bb-9349-a27b379170fd tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1204 microversion: 2.1 time: 0.095280 May 27 09:45:28.788278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 354/714] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:28 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:29.804877 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0a3cc9ef-4105-49fe-9cc9-f8fdbe8b8468 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:29.805731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0a3cc9ef-4105-49fe-9cc9-f8fdbe8b8468 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:29.812309 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0a3cc9ef-4105-49fe-9cc9-f8fdbe8b8468 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:29.812809 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0a3cc9ef-4105-49fe-9cc9-f8fdbe8b8468 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:29.813607 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0a3cc9ef-4105-49fe-9cc9-f8fdbe8b8468 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:29.814049 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0a3cc9ef-4105-49fe-9cc9-f8fdbe8b8468 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:30.050720 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0a3cc9ef-4105-49fe-9cc9-f8fdbe8b8468 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:30.058774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0a3cc9ef-4105-49fe-9cc9-f8fdbe8b8468 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.257845 May 27 09:45:30.066911 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 361/715] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:29 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:30.233694 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-c272e638-b62d-40d2-bb9e-8a599520c0e5 req-bf94b4fd-771b-450c-a5ab-e2960f4f3756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dd536e-b54a-4af0-8010-b44bca82fbe9", "tag": "a7bf0759-e717-4ad7-bf72-ba59bd3a1455"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:30.244802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-c272e638-b62d-40d2-bb9e-8a599520c0e5 req-bf94b4fd-771b-450c-a5ab-e2960f4f3756 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:30.245628 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-c272e638-b62d-40d2-bb9e-8a599520c0e5 req-bf94b4fd-771b-450c-a5ab-e2960f4f3756 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:30.250928 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:30.268601 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-c272e638-b62d-40d2-bb9e-8a599520c0e5 req-bf94b4fd-771b-450c-a5ab-e2960f4f3756 service nova] Creating event network-changed:a7bf0759-e717-4ad7-bf72-ba59bd3a1455 for instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 on hv-cinder-79760 May 27 09:45:30.273946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-c272e638-b62d-40d2-bb9e-8a599520c0e5 req-bf94b4fd-771b-450c-a5ab-e2960f4f3756 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044250 May 27 09:45:30.274866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 355/716] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:31.076135 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-03167349-f7ef-4b47-ad83-fe10edfaf032 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:31.076817 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-03167349-f7ef-4b47-ad83-fe10edfaf032 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:31.083222 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-03167349-f7ef-4b47-ad83-fe10edfaf032 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:31.083700 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-03167349-f7ef-4b47-ad83-fe10edfaf032 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:31.084460 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-03167349-f7ef-4b47-ad83-fe10edfaf032 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:31.084894 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-03167349-f7ef-4b47-ad83-fe10edfaf032 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:31.211307 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-03167349-f7ef-4b47-ad83-fe10edfaf032 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:31.219453 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-03167349-f7ef-4b47-ad83-fe10edfaf032 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.147108 May 27 09:45:31.220021 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 362/717] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:31 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:32.237071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0b74f48a-1007-437d-9906-e5ba4496de27 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:32.237767 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0b74f48a-1007-437d-9906-e5ba4496de27 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:32.245128 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b74f48a-1007-437d-9906-e5ba4496de27 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:32.245517 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b74f48a-1007-437d-9906-e5ba4496de27 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:32.246278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b74f48a-1007-437d-9906-e5ba4496de27 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:32.246708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b74f48a-1007-437d-9906-e5ba4496de27 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:32.461109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0b74f48a-1007-437d-9906-e5ba4496de27 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:32.469392 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0b74f48a-1007-437d-9906-e5ba4496de27 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.237881 May 27 09:45:32.469955 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 356/718] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:32 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:33.486350 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-72dbb733-2afc-4105-8273-917af5fc6a52 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:33.486899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-72dbb733-2afc-4105-8273-917af5fc6a52 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:33.493387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72dbb733-2afc-4105-8273-917af5fc6a52 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:33.493835 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72dbb733-2afc-4105-8273-917af5fc6a52 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:33.494596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72dbb733-2afc-4105-8273-917af5fc6a52 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:33.495028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72dbb733-2afc-4105-8273-917af5fc6a52 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:33.621636 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-72dbb733-2afc-4105-8273-917af5fc6a52 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:33.629479 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-72dbb733-2afc-4105-8273-917af5fc6a52 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.147523 May 27 09:45:33.630046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 363/719] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:33 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:34.431208 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-820c6f90-5641-40f9-8235-e38415645007 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4b4a529-6aab-4a1b-9b7f-01ea747b3bb2"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:34.432335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-820c6f90-5641-40f9-8235-e38415645007 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:34.438391 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-820c6f90-5641-40f9-8235-e38415645007 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:34.438840 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-820c6f90-5641-40f9-8235-e38415645007 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:34.439633 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-820c6f90-5641-40f9-8235-e38415645007 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:34.440072 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-820c6f90-5641-40f9-8235-e38415645007 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:34.646593 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5017635d-da15-443d-9376-620fe447000b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:34.647205 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5017635d-da15-443d-9376-620fe447000b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:34.653866 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5017635d-da15-443d-9376-620fe447000b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:34.654432 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5017635d-da15-443d-9376-620fe447000b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:34.655216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5017635d-da15-443d-9376-620fe447000b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:34.655690 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5017635d-da15-443d-9376-620fe447000b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:34.708605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-820c6f90-5641-40f9-8235-e38415645007 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384935 May 27 09:45:34.709240 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 357/720] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:45:34 2022] POST /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:34.814573 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5017635d-da15-443d-9376-620fe447000b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:34.825878 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5017635d-da15-443d-9376-620fe447000b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.182794 May 27 09:45:34.826724 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 364/721] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:34 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:35.847910 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4221cf86-fecf-42fd-86ff-bf5010edf093 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:35.848603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4221cf86-fecf-42fd-86ff-bf5010edf093 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:35.850506 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:35.856607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4221cf86-fecf-42fd-86ff-bf5010edf093 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:35.857340 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4221cf86-fecf-42fd-86ff-bf5010edf093 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:35.858141 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4221cf86-fecf-42fd-86ff-bf5010edf093 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:35.858575 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4221cf86-fecf-42fd-86ff-bf5010edf093 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:35.986674 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4221cf86-fecf-42fd-86ff-bf5010edf093 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:35.994085 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4221cf86-fecf-42fd-86ff-bf5010edf093 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.150975 May 27 09:45:35.994644 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 358/722] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:35 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:37.011461 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e3afa011-3d9b-4651-b532-fc02be22e628 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:37.012070 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e3afa011-3d9b-4651-b532-fc02be22e628 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:37.014502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=40 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:37.019824 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e3afa011-3d9b-4651-b532-fc02be22e628 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:37.020275 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e3afa011-3d9b-4651-b532-fc02be22e628 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:37.021035 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e3afa011-3d9b-4651-b532-fc02be22e628 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:37.021471 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e3afa011-3d9b-4651-b532-fc02be22e628 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:37.150599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e3afa011-3d9b-4651-b532-fc02be22e628 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:37.158513 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e3afa011-3d9b-4651-b532-fc02be22e628 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.150966 May 27 09:45:37.159079 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 365/723] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:37 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:38.176189 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-64ab0877-3cd2-4cc3-845b-23c00d7a8c15 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:38.176800 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-64ab0877-3cd2-4cc3-845b-23c00d7a8c15 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:38.179033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:38.179737 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=6 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:38.186187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-64ab0877-3cd2-4cc3-845b-23c00d7a8c15 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:38.186631 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-64ab0877-3cd2-4cc3-845b-23c00d7a8c15 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:38.188044 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-64ab0877-3cd2-4cc3-845b-23c00d7a8c15 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:38.188479 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-64ab0877-3cd2-4cc3-845b-23c00d7a8c15 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:38.325214 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-64ab0877-3cd2-4cc3-845b-23c00d7a8c15 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:38.332621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-64ab0877-3cd2-4cc3-845b-23c00d7a8c15 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.160293 May 27 09:45:38.333182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 359/724] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:38 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:39.350025 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-872f71ab-8bec-40af-9cd0-00c1c26fcdea tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:39.350670 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-872f71ab-8bec-40af-9cd0-00c1c26fcdea tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:39.352588 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:39.358432 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-872f71ab-8bec-40af-9cd0-00c1c26fcdea tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:39.359454 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-872f71ab-8bec-40af-9cd0-00c1c26fcdea tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:39.360247 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-872f71ab-8bec-40af-9cd0-00c1c26fcdea tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:39.360681 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-872f71ab-8bec-40af-9cd0-00c1c26fcdea tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:39.487865 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-872f71ab-8bec-40af-9cd0-00c1c26fcdea tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:39.495433 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-872f71ab-8bec-40af-9cd0-00c1c26fcdea tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.149184 May 27 09:45:39.496069 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 366/725] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:39 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:40.512134 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-68b41e23-8c93-483e-86bf-906306b1cf0e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:40.512746 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-68b41e23-8c93-483e-86bf-906306b1cf0e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:40.519131 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-68b41e23-8c93-483e-86bf-906306b1cf0e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:40.519619 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-68b41e23-8c93-483e-86bf-906306b1cf0e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:40.520382 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-68b41e23-8c93-483e-86bf-906306b1cf0e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:40.520819 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-68b41e23-8c93-483e-86bf-906306b1cf0e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:40.651307 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-68b41e23-8c93-483e-86bf-906306b1cf0e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:40.659587 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-68b41e23-8c93-483e-86bf-906306b1cf0e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.151292 May 27 09:45:40.660359 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 360/726] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:40 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:41.676834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8f2292cc-bd92-4517-9481-d39d9083d843 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:41.677444 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8f2292cc-bd92-4517-9481-d39d9083d843 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:41.683898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f2292cc-bd92-4517-9481-d39d9083d843 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:41.684347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f2292cc-bd92-4517-9481-d39d9083d843 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:41.685105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f2292cc-bd92-4517-9481-d39d9083d843 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:41.685539 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f2292cc-bd92-4517-9481-d39d9083d843 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:41.688092 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=92 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:41.812563 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8f2292cc-bd92-4517-9481-d39d9083d843 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:41.820082 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8f2292cc-bd92-4517-9481-d39d9083d843 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.147075 May 27 09:45:41.821997 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 367/727] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:41 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:42.180878 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-1399a711-eda0-4462-b0ca-50529c8cf9d5 req-b86c97ba-6c4a-42b6-934c-ec93eae342ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dd536e-b54a-4af0-8010-b44bca82fbe9", "name": "network-vif-plugged", "status": "completed", "tag": "a7bf0759-e717-4ad7-bf72-ba59bd3a1455"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:42.190995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-1399a711-eda0-4462-b0ca-50529c8cf9d5 req-b86c97ba-6c4a-42b6-934c-ec93eae342ae service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:42.191634 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-1399a711-eda0-4462-b0ca-50529c8cf9d5 req-b86c97ba-6c4a-42b6-934c-ec93eae342ae service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:42.205306 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-1399a711-eda0-4462-b0ca-50529c8cf9d5 req-b86c97ba-6c4a-42b6-934c-ec93eae342ae service nova] Creating event network-vif-plugged:a7bf0759-e717-4ad7-bf72-ba59bd3a1455 for instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 on hv-cinder-79760 May 27 09:45:42.210395 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-1399a711-eda0-4462-b0ca-50529c8cf9d5 req-b86c97ba-6c4a-42b6-934c-ec93eae342ae service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033334 May 27 09:45:42.211190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 361/728] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:42.837416 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-628ac0f8-819b-4d69-9502-81486ed2368e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:42.837959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-628ac0f8-819b-4d69-9502-81486ed2368e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:42.845174 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-628ac0f8-819b-4d69-9502-81486ed2368e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:42.845623 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-628ac0f8-819b-4d69-9502-81486ed2368e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:42.846396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-628ac0f8-819b-4d69-9502-81486ed2368e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:42.846833 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-628ac0f8-819b-4d69-9502-81486ed2368e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:42.977019 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-628ac0f8-819b-4d69-9502-81486ed2368e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:42.985034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-628ac0f8-819b-4d69-9502-81486ed2368e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.151594 May 27 09:45:42.985598 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 368/729] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:42 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:43.255708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4a9e17ef-d3b8-4d4d-99d7-882d5194f7a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:43.256723 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4a9e17ef-d3b8-4d4d-99d7-882d5194f7a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:43.262746 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4a9e17ef-d3b8-4d4d-99d7-882d5194f7a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:43.263190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4a9e17ef-d3b8-4d4d-99d7-882d5194f7a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:43.263980 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4a9e17ef-d3b8-4d4d-99d7-882d5194f7a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:43.264413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4a9e17ef-d3b8-4d4d-99d7-882d5194f7a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:43.287123 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-4a9e17ef-d3b8-4d4d-99d7-882d5194f7a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lazy-loading 'flavor' on Instance uuid 4572f19b-c60d-461e-8eec-9c9f8a25201c {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:45:43.439158 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4a9e17ef-d3b8-4d4d-99d7-882d5194f7a0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/action" status: 200 len: 32 microversion: 2.1 time: 0.188136 May 27 09:45:43.439721 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 362/730] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:45:43 2022] POST /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:45:43.450868 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-db3a5a44-6485-4ba0-b007-e4bd5a1e0c71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:43.451612 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-db3a5a44-6485-4ba0-b007-e4bd5a1e0c71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:43.458672 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-db3a5a44-6485-4ba0-b007-e4bd5a1e0c71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:43.459116 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-db3a5a44-6485-4ba0-b007-e4bd5a1e0c71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:43.459903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-db3a5a44-6485-4ba0-b007-e4bd5a1e0c71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:43.460335 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-db3a5a44-6485-4ba0-b007-e4bd5a1e0c71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:43.585437 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-db3a5a44-6485-4ba0-b007-e4bd5a1e0c71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:43.594263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-db3a5a44-6485-4ba0-b007-e4bd5a1e0c71 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.149407 May 27 09:45:43.594833 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 369/731] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:43 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:44.002820 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-01d9984b-3ba7-4073-bd83-2ae65c9f7576 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:44.003552 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-01d9984b-3ba7-4073-bd83-2ae65c9f7576 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:44.009909 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-01d9984b-3ba7-4073-bd83-2ae65c9f7576 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:44.010362 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-01d9984b-3ba7-4073-bd83-2ae65c9f7576 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:44.011142 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-01d9984b-3ba7-4073-bd83-2ae65c9f7576 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:44.011773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-01d9984b-3ba7-4073-bd83-2ae65c9f7576 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:44.224632 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-01d9984b-3ba7-4073-bd83-2ae65c9f7576 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:44.232136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-01d9984b-3ba7-4073-bd83-2ae65c9f7576 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1260 microversion: 2.1 time: 0.234207 May 27 09:45:44.232701 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 363/732] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:43 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:44.610538 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fb9a4cfa-7bac-4844-b24c-977928a7fe44 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:44.611150 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fb9a4cfa-7bac-4844-b24c-977928a7fe44 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:44.617570 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb9a4cfa-7bac-4844-b24c-977928a7fe44 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:44.618014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb9a4cfa-7bac-4844-b24c-977928a7fe44 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:44.618771 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb9a4cfa-7bac-4844-b24c-977928a7fe44 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:44.619213 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb9a4cfa-7bac-4844-b24c-977928a7fe44 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:44.746729 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fb9a4cfa-7bac-4844-b24c-977928a7fe44 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:44.755871 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fb9a4cfa-7bac-4844-b24c-977928a7fe44 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.149241 May 27 09:45:44.756504 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 370/733] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:44 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:45.249093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-92046f34-e9ed-43ce-9a13-ddac3e70dd5a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:45.249623 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-92046f34-e9ed-43ce-9a13-ddac3e70dd5a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:45.256821 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-92046f34-e9ed-43ce-9a13-ddac3e70dd5a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:45.257267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-92046f34-e9ed-43ce-9a13-ddac3e70dd5a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:45.258027 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-92046f34-e9ed-43ce-9a13-ddac3e70dd5a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:45.258460 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-92046f34-e9ed-43ce-9a13-ddac3e70dd5a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:45.390016 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-92046f34-e9ed-43ce-9a13-ddac3e70dd5a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:45.398359 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-92046f34-e9ed-43ce-9a13-ddac3e70dd5a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1445 microversion: 2.1 time: 0.153243 May 27 09:45:45.398922 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 364/734] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:45 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:45.414480 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0fadf2d8-b73c-4c8e-8ccf-a04605f495a2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:45.415085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0fadf2d8-b73c-4c8e-8ccf-a04605f495a2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:45.421028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0fadf2d8-b73c-4c8e-8ccf-a04605f495a2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:45.421472 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0fadf2d8-b73c-4c8e-8ccf-a04605f495a2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:45.422783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0fadf2d8-b73c-4c8e-8ccf-a04605f495a2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:45.423219 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0fadf2d8-b73c-4c8e-8ccf-a04605f495a2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:45.773133 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4f5e2e0a-4d17-4c13-bdc9-2b04811170ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:45.773965 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4f5e2e0a-4d17-4c13-bdc9-2b04811170ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:45.779964 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f5e2e0a-4d17-4c13-bdc9-2b04811170ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:45.780417 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f5e2e0a-4d17-4c13-bdc9-2b04811170ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:45.781217 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f5e2e0a-4d17-4c13-bdc9-2b04811170ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:45.781641 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f5e2e0a-4d17-4c13-bdc9-2b04811170ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:45.782465 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0fadf2d8-b73c-4c8e-8ccf-a04605f495a2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:45.790015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0fadf2d8-b73c-4c8e-8ccf-a04605f495a2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1445 microversion: 2.1 time: 0.379302 May 27 09:45:45.790586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 371/735] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:45 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1445 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:45.937007 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4f5e2e0a-4d17-4c13-bdc9-2b04811170ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:45.945217 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4f5e2e0a-4d17-4c13-bdc9-2b04811170ff tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.175931 May 27 09:45:45.945812 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 365/736] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:45 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:45:46.962103 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-cd18fb51-a421-4935-88b0-c3203357e0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:46.962758 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-cd18fb51-a421-4935-88b0-c3203357e0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:46.969083 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cd18fb51-a421-4935-88b0-c3203357e0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:46.969533 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cd18fb51-a421-4935-88b0-c3203357e0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:46.970296 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cd18fb51-a421-4935-88b0-c3203357e0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:46.970738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cd18fb51-a421-4935-88b0-c3203357e0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:47.218590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cd18fb51-a421-4935-88b0-c3203357e0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:47.226381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-cd18fb51-a421-4935-88b0-c3203357e0b3 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.268346 May 27 09:45:47.226950 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 372/737] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:46 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:47.543873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-65d3e32e-b4e1-44fd-bc75-38404ca739d5 req-73c03388-b909-4ab9-b0cb-ea990aa4e62a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dd536e-b54a-4af0-8010-b44bca82fbe9", "tag": "a7bf0759-e717-4ad7-bf72-ba59bd3a1455"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:47.552064 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-65d3e32e-b4e1-44fd-bc75-38404ca739d5 req-73c03388-b909-4ab9-b0cb-ea990aa4e62a service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:47.552519 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-65d3e32e-b4e1-44fd-bc75-38404ca739d5 req-73c03388-b909-4ab9-b0cb-ea990aa4e62a service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:47.564055 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-65d3e32e-b4e1-44fd-bc75-38404ca739d5 req-73c03388-b909-4ab9-b0cb-ea990aa4e62a service nova] Creating event network-changed:a7bf0759-e717-4ad7-bf72-ba59bd3a1455 for instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 on hv-cinder-79760 May 27 09:45:47.569083 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-65d3e32e-b4e1-44fd-bc75-38404ca739d5 req-73c03388-b909-4ab9-b0cb-ea990aa4e62a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028868 May 27 09:45:47.569867 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 366/738] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:48.243917 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d4f6b35e-d06a-409b-8feb-2adc106c5617 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:48.244527 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d4f6b35e-d06a-409b-8feb-2adc106c5617 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:48.250992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4f6b35e-d06a-409b-8feb-2adc106c5617 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:48.251477 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4f6b35e-d06a-409b-8feb-2adc106c5617 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:48.252234 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4f6b35e-d06a-409b-8feb-2adc106c5617 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:48.252700 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d4f6b35e-d06a-409b-8feb-2adc106c5617 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:48.383661 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d4f6b35e-d06a-409b-8feb-2adc106c5617 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:48.392508 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d4f6b35e-d06a-409b-8feb-2adc106c5617 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.152367 May 27 09:45:48.393178 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 373/739] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:48 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:49.409959 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-34f13511-be40-4381-98eb-4ee981235bb5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:49.410663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-34f13511-be40-4381-98eb-4ee981235bb5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:49.417498 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-34f13511-be40-4381-98eb-4ee981235bb5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:49.417951 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-34f13511-be40-4381-98eb-4ee981235bb5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:49.418724 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-34f13511-be40-4381-98eb-4ee981235bb5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:49.419165 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-34f13511-be40-4381-98eb-4ee981235bb5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:49.551932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-34f13511-be40-4381-98eb-4ee981235bb5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:49.559874 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-34f13511-be40-4381-98eb-4ee981235bb5 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.154170 May 27 09:45:49.560441 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 367/740] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:49 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:50.578786 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f030883e-ed38-497d-89a3-be103a65db94 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:50.579420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f030883e-ed38-497d-89a3-be103a65db94 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:50.586109 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f030883e-ed38-497d-89a3-be103a65db94 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:50.586556 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f030883e-ed38-497d-89a3-be103a65db94 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:50.587545 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f030883e-ed38-497d-89a3-be103a65db94 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:50.587975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f030883e-ed38-497d-89a3-be103a65db94 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:50.719380 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f030883e-ed38-497d-89a3-be103a65db94 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:50.727265 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f030883e-ed38-497d-89a3-be103a65db94 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.154247 May 27 09:45:50.727852 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 374/741] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:50 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:51.743595 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2a97ca99-38c5-4da3-a68d-28ccf736cf2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:51.744213 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2a97ca99-38c5-4da3-a68d-28ccf736cf2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:51.751237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2a97ca99-38c5-4da3-a68d-28ccf736cf2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:51.751715 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2a97ca99-38c5-4da3-a68d-28ccf736cf2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:51.752481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2a97ca99-38c5-4da3-a68d-28ccf736cf2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:51.752919 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2a97ca99-38c5-4da3-a68d-28ccf736cf2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:51.880753 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2a97ca99-38c5-4da3-a68d-28ccf736cf2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:51.888586 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2a97ca99-38c5-4da3-a68d-28ccf736cf2f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.148909 May 27 09:45:51.889150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 368/742] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:51 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:52.905668 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9c109572-7146-450a-b1a5-5a81179ed7c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:52.906293 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9c109572-7146-450a-b1a5-5a81179ed7c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:52.912781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9c109572-7146-450a-b1a5-5a81179ed7c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:52.913225 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9c109572-7146-450a-b1a5-5a81179ed7c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:52.913987 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9c109572-7146-450a-b1a5-5a81179ed7c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:52.914424 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9c109572-7146-450a-b1a5-5a81179ed7c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:53.044622 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9c109572-7146-450a-b1a5-5a81179ed7c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:53.053355 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9c109572-7146-450a-b1a5-5a81179ed7c4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.151606 May 27 09:45:53.053919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 375/743] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:52 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:54.070825 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cf610c74-0534-4614-9f78-ef79b12448ca tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:54.071810 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cf610c74-0534-4614-9f78-ef79b12448ca tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:54.078377 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf610c74-0534-4614-9f78-ef79b12448ca tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:54.078832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf610c74-0534-4614-9f78-ef79b12448ca tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:54.080249 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf610c74-0534-4614-9f78-ef79b12448ca tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:54.080696 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cf610c74-0534-4614-9f78-ef79b12448ca tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:54.206827 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cf610c74-0534-4614-9f78-ef79b12448ca tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:54.214721 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cf610c74-0534-4614-9f78-ef79b12448ca tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.147780 May 27 09:45:54.215321 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 369/744] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:54 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:55.231343 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-35fadfe0-6e4c-4854-ab07-bdee88fbfc3b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:55.231958 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-35fadfe0-6e4c-4854-ab07-bdee88fbfc3b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:55.238959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35fadfe0-6e4c-4854-ab07-bdee88fbfc3b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:55.239440 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35fadfe0-6e4c-4854-ab07-bdee88fbfc3b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:55.240199 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35fadfe0-6e4c-4854-ab07-bdee88fbfc3b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:55.240634 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35fadfe0-6e4c-4854-ab07-bdee88fbfc3b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:55.368827 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-35fadfe0-6e4c-4854-ab07-bdee88fbfc3b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:55.377308 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-35fadfe0-6e4c-4854-ab07-bdee88fbfc3b tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.149898 May 27 09:45:55.377864 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 376/745] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:55 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:45:56.394837 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c27beaaa-a121-4157-9d41-3f1263582834 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:56.395468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c27beaaa-a121-4157-9d41-3f1263582834 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:56.401927 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c27beaaa-a121-4157-9d41-3f1263582834 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:56.402374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c27beaaa-a121-4157-9d41-3f1263582834 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:56.403128 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c27beaaa-a121-4157-9d41-3f1263582834 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:56.403591 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c27beaaa-a121-4157-9d41-3f1263582834 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:56.419878 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:56.532493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c27beaaa-a121-4157-9d41-3f1263582834 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:56.540302 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c27beaaa-a121-4157-9d41-3f1263582834 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.149910 May 27 09:45:56.540883 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 370/746] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:56 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:57.558095 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2a0a345e-9701-4193-8025-58ad843ebd57 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:57.558714 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2a0a345e-9701-4193-8025-58ad843ebd57 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:57.569948 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2a0a345e-9701-4193-8025-58ad843ebd57 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:57.570395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2a0a345e-9701-4193-8025-58ad843ebd57 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:57.571166 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2a0a345e-9701-4193-8025-58ad843ebd57 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:57.571635 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2a0a345e-9701-4193-8025-58ad843ebd57 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:57.702876 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2a0a345e-9701-4193-8025-58ad843ebd57 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:57.711343 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2a0a345e-9701-4193-8025-58ad843ebd57 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.157936 May 27 09:45:57.711907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 377/747] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:57 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:58.729210 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a2fae4f3-c3cf-45c1-8c59-e45d1c2a3cea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:58.729832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a2fae4f3-c3cf-45c1-8c59-e45d1c2a3cea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:58.737033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2fae4f3-c3cf-45c1-8c59-e45d1c2a3cea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:58.737566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2fae4f3-c3cf-45c1-8c59-e45d1c2a3cea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:58.738430 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2fae4f3-c3cf-45c1-8c59-e45d1c2a3cea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:58.738875 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2fae4f3-c3cf-45c1-8c59-e45d1c2a3cea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:58.946374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a2fae4f3-c3cf-45c1-8c59-e45d1c2a3cea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:58.955156 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a2fae4f3-c3cf-45c1-8c59-e45d1c2a3cea tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.229288 May 27 09:45:58.955793 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 371/748] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:58 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:59.787796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-72de95be-765c-47de-9159-ad4dee5b4875 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:59.788345 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-72de95be-765c-47de-9159-ad4dee5b4875 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:59.794666 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72de95be-765c-47de-9159-ad4dee5b4875 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:59.795118 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72de95be-765c-47de-9159-ad4dee5b4875 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:59.795928 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72de95be-765c-47de-9159-ad4dee5b4875 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:59.796372 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72de95be-765c-47de-9159-ad4dee5b4875 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:59.875754 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-72de95be-765c-47de-9159-ad4dee5b4875 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lazy-loading 'services' on Instance uuid d5c817de-8115-43f6-9a05-6366318ea29f {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:45:59.947148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-72de95be-765c-47de-9159-ad4dee5b4875 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/os-volume_attachments/a6ad0780-81c7-4ee1-b71a-e0b309664b21" status: 202 len: 0 microversion: 2.1 time: 0.163150 May 27 09:45:59.947990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 378/749] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:45:59 2022] DELETE /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/os-volume_attachments/a6ad0780-81c7-4ee1-b71a-e0b309664b21 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:45:59.974469 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0533af3a-9cd5-464a-906f-f587c4dc8cf8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:59.975265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0533af3a-9cd5-464a-906f-f587c4dc8cf8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:59.981771 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0533af3a-9cd5-464a-906f-f587c4dc8cf8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:59.982219 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0533af3a-9cd5-464a-906f-f587c4dc8cf8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:59.982987 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0533af3a-9cd5-464a-906f-f587c4dc8cf8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:59.983448 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0533af3a-9cd5-464a-906f-f587c4dc8cf8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:00.120531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0533af3a-9cd5-464a-906f-f587c4dc8cf8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:00.128414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0533af3a-9cd5-464a-906f-f587c4dc8cf8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.159759 May 27 09:46:00.128974 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 372/750] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:45:59 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:01.147312 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-acedb29a-c4af-4850-a420-47c6d5021eac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:01.147983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-acedb29a-c4af-4850-a420-47c6d5021eac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:01.154556 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-acedb29a-c4af-4850-a420-47c6d5021eac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:01.155001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-acedb29a-c4af-4850-a420-47c6d5021eac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:01.155788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-acedb29a-c4af-4850-a420-47c6d5021eac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:01.156215 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-acedb29a-c4af-4850-a420-47c6d5021eac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:01.284928 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-acedb29a-c4af-4850-a420-47c6d5021eac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:01.292734 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-acedb29a-c4af-4850-a420-47c6d5021eac tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.151041 May 27 09:46:01.293289 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 379/751] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:01 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:02.114212 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4ac6aff9-9aca-46af-8f22-fb9cf1435785 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:02.120632 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4ac6aff9-9aca-46af-8f22-fb9cf1435785 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:02.121085 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4ac6aff9-9aca-46af-8f22-fb9cf1435785 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:02.142915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4ac6aff9-9aca-46af-8f22-fb9cf1435785 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Going to try to stop instance {{(pid=129291) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 09:46:02.186303 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4ac6aff9-9aca-46af-8f22-fb9cf1435785 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/action" status: 202 len: 0 microversion: 2.1 time: 0.075685 May 27 09:46:02.186891 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 373/752] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:46:02 2022] POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:46:02.194799 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-80fca449-4292-4cb1-aafc-8fa0c83fbfe2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:02.195447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-80fca449-4292-4cb1-aafc-8fa0c83fbfe2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:02.201832 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-80fca449-4292-4cb1-aafc-8fa0c83fbfe2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:02.202274 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-80fca449-4292-4cb1-aafc-8fa0c83fbfe2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:02.203031 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-80fca449-4292-4cb1-aafc-8fa0c83fbfe2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:02.203492 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-80fca449-4292-4cb1-aafc-8fa0c83fbfe2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:02.310340 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-34a85e07-88d2-48e3-857a-3af36bddeb53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:02.311049 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-34a85e07-88d2-48e3-857a-3af36bddeb53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:02.317857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-34a85e07-88d2-48e3-857a-3af36bddeb53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:02.318253 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-34a85e07-88d2-48e3-857a-3af36bddeb53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:02.319025 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-34a85e07-88d2-48e3-857a-3af36bddeb53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:02.319510 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-34a85e07-88d2-48e3-857a-3af36bddeb53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:02.334862 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-80fca449-4292-4cb1-aafc-8fa0c83fbfe2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:02.342649 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-80fca449-4292-4cb1-aafc-8fa0c83fbfe2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.151545 May 27 09:46:02.343210 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 380/753] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:02 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:02.457997 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-34a85e07-88d2-48e3-857a-3af36bddeb53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:02.465880 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-34a85e07-88d2-48e3-857a-3af36bddeb53 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.159739 May 27 09:46:02.466742 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 374/754] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:02 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:46:03.359960 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b2622830-9319-49d7-870b-db6ca99d9b74 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:03.361186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b2622830-9319-49d7-870b-db6ca99d9b74 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:03.367684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b2622830-9319-49d7-870b-db6ca99d9b74 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:03.368133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b2622830-9319-49d7-870b-db6ca99d9b74 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:03.368907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b2622830-9319-49d7-870b-db6ca99d9b74 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:03.369343 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b2622830-9319-49d7-870b-db6ca99d9b74 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:03.483305 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-51732861-29b4-4c57-9537-6903aa45e2ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:03.483978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-51732861-29b4-4c57-9537-6903aa45e2ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:03.490094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-51732861-29b4-4c57-9537-6903aa45e2ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:03.490539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-51732861-29b4-4c57-9537-6903aa45e2ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:03.491325 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-51732861-29b4-4c57-9537-6903aa45e2ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:03.491759 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-51732861-29b4-4c57-9537-6903aa45e2ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:03.523479 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b2622830-9319-49d7-870b-db6ca99d9b74 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:03.531099 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b2622830-9319-49d7-870b-db6ca99d9b74 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.175070 May 27 09:46:03.531704 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 381/755] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:03 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:03.616759 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-51732861-29b4-4c57-9537-6903aa45e2ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:03.624826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-51732861-29b4-4c57-9537-6903aa45e2ae tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.145451 May 27 09:46:03.625396 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 375/756] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:03 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:46:04.548918 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5fab330c-8338-4ee4-b1fc-be5a3f8f9874 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:04.549559 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5fab330c-8338-4ee4-b1fc-be5a3f8f9874 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:04.555938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5fab330c-8338-4ee4-b1fc-be5a3f8f9874 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:04.556387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5fab330c-8338-4ee4-b1fc-be5a3f8f9874 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:04.557148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5fab330c-8338-4ee4-b1fc-be5a3f8f9874 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:04.557582 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5fab330c-8338-4ee4-b1fc-be5a3f8f9874 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:04.641672 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cb5e4264-8c7a-4454-a7b6-6b85ef68ed73 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:04.642288 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cb5e4264-8c7a-4454-a7b6-6b85ef68ed73 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:04.648744 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb5e4264-8c7a-4454-a7b6-6b85ef68ed73 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:04.649190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb5e4264-8c7a-4454-a7b6-6b85ef68ed73 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:04.649959 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb5e4264-8c7a-4454-a7b6-6b85ef68ed73 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:04.650389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb5e4264-8c7a-4454-a7b6-6b85ef68ed73 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:04.683319 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5fab330c-8338-4ee4-b1fc-be5a3f8f9874 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:04.690743 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5fab330c-8338-4ee4-b1fc-be5a3f8f9874 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.146315 May 27 09:46:04.691796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 382/757] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:04 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:04.783748 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cb5e4264-8c7a-4454-a7b6-6b85ef68ed73 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:04.791537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cb5e4264-8c7a-4454-a7b6-6b85ef68ed73 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1734 microversion: 2.1 time: 0.153565 May 27 09:46:04.792104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 376/758] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:04 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:46:05.708028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8158ac1e-a43c-45c9-ae2e-d05f211ed230 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:05.708633 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8158ac1e-a43c-45c9-ae2e-d05f211ed230 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:05.715102 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8158ac1e-a43c-45c9-ae2e-d05f211ed230 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:05.715590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8158ac1e-a43c-45c9-ae2e-d05f211ed230 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:05.716646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8158ac1e-a43c-45c9-ae2e-d05f211ed230 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:05.717081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8158ac1e-a43c-45c9-ae2e-d05f211ed230 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:05.721024 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:05.809359 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-26993905-8ecc-485d-82e4-9bc55831ff56 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:05.810054 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-26993905-8ecc-485d-82e4-9bc55831ff56 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:05.817189 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-26993905-8ecc-485d-82e4-9bc55831ff56 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:05.817710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-26993905-8ecc-485d-82e4-9bc55831ff56 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:05.818571 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-26993905-8ecc-485d-82e4-9bc55831ff56 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:05.819006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-26993905-8ecc-485d-82e4-9bc55831ff56 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:05.845705 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8158ac1e-a43c-45c9-ae2e-d05f211ed230 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:05.853280 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8158ac1e-a43c-45c9-ae2e-d05f211ed230 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.149088 May 27 09:46:05.853854 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 383/759] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:05 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:05.946642 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-26993905-8ecc-485d-82e4-9bc55831ff56 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:05.954544 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-26993905-8ecc-485d-82e4-9bc55831ff56 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1714 microversion: 2.1 time: 0.149016 May 27 09:46:05.955117 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 377/760] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:05 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1714 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:46:06.015122 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-85bda2a6-13c7-4d3a-b37f-430c63d32555 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:06.015641 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-85bda2a6-13c7-4d3a-b37f-430c63d32555 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:06.021520 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-85bda2a6-13c7-4d3a-b37f-430c63d32555 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:06.021966 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-85bda2a6-13c7-4d3a-b37f-430c63d32555 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:06.022713 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-85bda2a6-13c7-4d3a-b37f-430c63d32555 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:06.023138 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-85bda2a6-13c7-4d3a-b37f-430c63d32555 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:06.103149 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-85bda2a6-13c7-4d3a-b37f-430c63d32555 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] HTTP exception thrown: Cannot 'detach_volume' instance 4572f19b-c60d-461e-8eec-9c9f8a25201c while it is in vm_state rescued May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-85bda2a6-13c7-4d3a-b37f-430c63d32555 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Request method failure captured: May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: DELETE /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments/d4b4a529-6aab-4a1b-9b7f-01ea747b3bb2 HTTP/1.1 May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJw8E69kc370trEXLpeY6UITestdwiquS5mhSQcfPgVOJi0R1BN1wUgAoLk7mJ_L26eDt4wZYQTLjuroG7w77s0HjSvRGsjWg8o4I5dW0q4LWmFIv0U1ANsH9YdQbasIIX2q8iO712z46SNFk9oHoWfSqkGNcR1-QodSA-SM0eE8kFI May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 0cad683f27d14cf5a90a19525a467a52 May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:46:06.104746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0cad683f27d14cf5a90a19525a467a52"}]}] May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 0cad683f27d14cf5a90a19525a467a52 May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-ServerRescueNegativeTestJSON-221303946-project May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 1331ba69eaec44dd9bd8f8db7d53ba5c May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-ServerRescueNegativeTestJSON-221303946-project May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:46:06.106317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Cannot 'detach_volume' instance 4572f19b-c60d-461e-8eec-9c9f8a25201c while it is in vm_state rescued May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'server_id': '4572f19b-c60d-461e-8eec-9c9f8a25201c', 'id': 'd4b4a529-6aab-4a1b-9b7f-01ea747b3bb2'} May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4572f19b-c60d-461e-8eec-9c9f8a25201c in vm_state rescued. Cannot detach_volume while the instance is in this state. May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:46:06.107143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4572f19b-c60d-461e-8eec-9c9f8a25201c while it is in vm_state rescued May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4572f19b-c60d-461e-8eec-9c9f8a25201c while it is in vm_state rescued May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:06.108727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-85bda2a6-13c7-4d3a-b37f-430c63d32555 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Returning 409 to user: Cannot 'detach_volume' instance 4572f19b-c60d-461e-8eec-9c9f8a25201c while it is in vm_state rescued {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:46:06.109869 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-85bda2a6-13c7-4d3a-b37f-430c63d32555 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments/d4b4a529-6aab-4a1b-9b7f-01ea747b3bb2" status: 409 len: 152 microversion: 2.1 time: 0.094967 May 27 09:46:06.109869 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 384/761] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:46:06 2022] DELETE /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments/d4b4a529-6aab-4a1b-9b7f-01ea747b3bb2 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 09:46:06.115667 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-063e2e0a-d003-452b-a96b-ddc715d1b711 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:06.116207 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-063e2e0a-d003-452b-a96b-ddc715d1b711 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:06.118158 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=40 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:06.123477 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-063e2e0a-d003-452b-a96b-ddc715d1b711 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:06.123925 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-063e2e0a-d003-452b-a96b-ddc715d1b711 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:06.124687 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-063e2e0a-d003-452b-a96b-ddc715d1b711 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:06.125124 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-063e2e0a-d003-452b-a96b-ddc715d1b711 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:06.188032 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-063e2e0a-d003-452b-a96b-ddc715d1b711 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "POST /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/action" status: 202 len: 0 microversion: 2.1 time: 0.076132 May 27 09:46:06.191752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 378/762] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:46:06 2022] POST /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:46:06.198758 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a3979d16-7df9-4a10-b082-900564ba617f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:06.199409 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a3979d16-7df9-4a10-b082-900564ba617f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:06.206834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a3979d16-7df9-4a10-b082-900564ba617f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:06.207411 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a3979d16-7df9-4a10-b082-900564ba617f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:06.208747 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a3979d16-7df9-4a10-b082-900564ba617f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:06.209287 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a3979d16-7df9-4a10-b082-900564ba617f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:06.420888 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a3979d16-7df9-4a10-b082-900564ba617f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:06.429311 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a3979d16-7df9-4a10-b082-900564ba617f tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1722 microversion: 2.1 time: 0.235236 May 27 09:46:06.429880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 385/763] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:06 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:06.871896 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-72145bcd-cb0d-41da-8558-9605ab6ab778 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:06.873215 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-72145bcd-cb0d-41da-8558-9605ab6ab778 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:06.879509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-72145bcd-cb0d-41da-8558-9605ab6ab778 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:06.879962 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-72145bcd-cb0d-41da-8558-9605ab6ab778 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:06.880725 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-72145bcd-cb0d-41da-8558-9605ab6ab778 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:06.881171 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-72145bcd-cb0d-41da-8558-9605ab6ab778 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:07.009900 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-72145bcd-cb0d-41da-8558-9605ab6ab778 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:07.020169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-72145bcd-cb0d-41da-8558-9605ab6ab778 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.152990 May 27 09:46:07.021096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 379/764] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:06 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:07.446932 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-49b6e2c5-1c6c-4794-97e3-70a42528a7d7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:07.447483 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-49b6e2c5-1c6c-4794-97e3-70a42528a7d7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:07.449717 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=42 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:07.455534 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-49b6e2c5-1c6c-4794-97e3-70a42528a7d7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:07.455978 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-49b6e2c5-1c6c-4794-97e3-70a42528a7d7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:07.456734 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-49b6e2c5-1c6c-4794-97e3-70a42528a7d7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:07.457162 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-49b6e2c5-1c6c-4794-97e3-70a42528a7d7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:07.582829 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-49b6e2c5-1c6c-4794-97e3-70a42528a7d7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:07.590687 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-49b6e2c5-1c6c-4794-97e3-70a42528a7d7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1722 microversion: 2.1 time: 0.147725 May 27 09:46:07.591541 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 386/765] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:07 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:08.036782 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2e6f4a48-aff8-49f9-9990-934ef4fa5a09 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:08.037394 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2e6f4a48-aff8-49f9-9990-934ef4fa5a09 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:08.043653 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2e6f4a48-aff8-49f9-9990-934ef4fa5a09 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:08.044105 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2e6f4a48-aff8-49f9-9990-934ef4fa5a09 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:08.044869 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2e6f4a48-aff8-49f9-9990-934ef4fa5a09 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:08.045305 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2e6f4a48-aff8-49f9-9990-934ef4fa5a09 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:08.170905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2e6f4a48-aff8-49f9-9990-934ef4fa5a09 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:08.178866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2e6f4a48-aff8-49f9-9990-934ef4fa5a09 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.145971 May 27 09:46:08.179454 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 380/766] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:08 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:08.607175 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-45180f3f-cd01-4989-bdf5-a2edc00aa7f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:08.607818 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-45180f3f-cd01-4989-bdf5-a2edc00aa7f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:08.614265 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-45180f3f-cd01-4989-bdf5-a2edc00aa7f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:08.614714 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-45180f3f-cd01-4989-bdf5-a2edc00aa7f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:08.615506 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-45180f3f-cd01-4989-bdf5-a2edc00aa7f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:08.615940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-45180f3f-cd01-4989-bdf5-a2edc00aa7f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:08.744812 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-45180f3f-cd01-4989-bdf5-a2edc00aa7f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:08.753272 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-45180f3f-cd01-4989-bdf5-a2edc00aa7f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1722 microversion: 2.1 time: 0.149989 May 27 09:46:08.753829 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 387/767] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:08 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:09.195194 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c69460c7-bb1a-4b1c-b7fc-e7f5603ee86a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:09.195858 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c69460c7-bb1a-4b1c-b7fc-e7f5603ee86a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:09.202346 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c69460c7-bb1a-4b1c-b7fc-e7f5603ee86a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:09.202801 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c69460c7-bb1a-4b1c-b7fc-e7f5603ee86a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:09.203613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c69460c7-bb1a-4b1c-b7fc-e7f5603ee86a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:09.204060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c69460c7-bb1a-4b1c-b7fc-e7f5603ee86a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:09.329331 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c69460c7-bb1a-4b1c-b7fc-e7f5603ee86a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:09.336740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c69460c7-bb1a-4b1c-b7fc-e7f5603ee86a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.145453 May 27 09:46:09.337309 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 381/768] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:09 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:09.770398 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-18b1528f-6884-4483-9a24-57b919ac2692 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:09.771012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-18b1528f-6884-4483-9a24-57b919ac2692 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:09.777497 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18b1528f-6884-4483-9a24-57b919ac2692 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:09.777949 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18b1528f-6884-4483-9a24-57b919ac2692 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:09.778711 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18b1528f-6884-4483-9a24-57b919ac2692 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:09.779148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18b1528f-6884-4483-9a24-57b919ac2692 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:09.909233 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-18b1528f-6884-4483-9a24-57b919ac2692 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:09.917344 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-18b1528f-6884-4483-9a24-57b919ac2692 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1722 microversion: 2.1 time: 0.151304 May 27 09:46:09.917921 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 388/769] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:09 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:10.355073 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b7b29120-c302-4918-949f-32de61fe0801 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:10.355657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b7b29120-c302-4918-949f-32de61fe0801 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:10.362807 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b7b29120-c302-4918-949f-32de61fe0801 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:10.363307 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b7b29120-c302-4918-949f-32de61fe0801 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:10.364079 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b7b29120-c302-4918-949f-32de61fe0801 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:10.364527 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b7b29120-c302-4918-949f-32de61fe0801 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:10.497637 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b7b29120-c302-4918-949f-32de61fe0801 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:10.506533 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b7b29120-c302-4918-949f-32de61fe0801 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.155225 May 27 09:46:10.507232 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 382/770] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:10 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:10.934271 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-774fa3bd-c25c-4e0c-a78c-b360d504b096 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:10.934785 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-774fa3bd-c25c-4e0c-a78c-b360d504b096 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:10.941222 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-774fa3bd-c25c-4e0c-a78c-b360d504b096 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:10.941662 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-774fa3bd-c25c-4e0c-a78c-b360d504b096 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:10.942417 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-774fa3bd-c25c-4e0c-a78c-b360d504b096 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:10.942851 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-774fa3bd-c25c-4e0c-a78c-b360d504b096 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:11.071617 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-774fa3bd-c25c-4e0c-a78c-b360d504b096 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:11.080064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-774fa3bd-c25c-4e0c-a78c-b360d504b096 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1728 microversion: 2.1 time: 0.149676 May 27 09:46:11.080624 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 389/771] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:10 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:11.096901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-66ba9dd1-f520-432b-af65-93e5a8f7c247 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:11.097399 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-66ba9dd1-f520-432b-af65-93e5a8f7c247 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:11.103267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-66ba9dd1-f520-432b-af65-93e5a8f7c247 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:11.103748 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-66ba9dd1-f520-432b-af65-93e5a8f7c247 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:11.104512 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-66ba9dd1-f520-432b-af65-93e5a8f7c247 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:11.104948 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-66ba9dd1-f520-432b-af65-93e5a8f7c247 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:11.179594 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-66ba9dd1-f520-432b-af65-93e5a8f7c247 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087037 May 27 09:46:11.180186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 383/772] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 09:46:11 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:11.523539 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8268fd0b-9020-41e2-9237-262f2aefff9b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:11.524147 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8268fd0b-9020-41e2-9237-262f2aefff9b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:11.530107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8268fd0b-9020-41e2-9237-262f2aefff9b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:11.530548 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8268fd0b-9020-41e2-9237-262f2aefff9b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:11.531478 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8268fd0b-9020-41e2-9237-262f2aefff9b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:11.531936 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8268fd0b-9020-41e2-9237-262f2aefff9b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:11.762743 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8268fd0b-9020-41e2-9237-262f2aefff9b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:11.770304 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8268fd0b-9020-41e2-9237-262f2aefff9b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.250597 May 27 09:46:11.770971 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 390/773] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:11 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:12.154149 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-488b320c-1c4f-4299-9c5a-0e5a4b6c6708 req-f76cd5e3-c868-4734-83cd-81dcc6bfe24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4572f19b-c60d-461e-8eec-9c9f8a25201c", "tag": "be291203-ca93-4891-adc1-934c52d11bd3"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:12.163435 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-488b320c-1c4f-4299-9c5a-0e5a4b6c6708 req-f76cd5e3-c868-4734-83cd-81dcc6bfe24a service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:12.164020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-488b320c-1c4f-4299-9c5a-0e5a4b6c6708 req-f76cd5e3-c868-4734-83cd-81dcc6bfe24a service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:12.178539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-488b320c-1c4f-4299-9c5a-0e5a4b6c6708 req-f76cd5e3-c868-4734-83cd-81dcc6bfe24a service nova] Creating event network-changed:be291203-ca93-4891-adc1-934c52d11bd3 for instance 4572f19b-c60d-461e-8eec-9c9f8a25201c on hv-cinder-79760 May 27 09:46:12.183752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-488b320c-1c4f-4299-9c5a-0e5a4b6c6708 req-f76cd5e3-c868-4734-83cd-81dcc6bfe24a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033754 May 27 09:46:12.184351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 384/774] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:12.788369 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ffd5d494-1450-428a-b50f-7667b5fe10ca tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:12.789129 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ffd5d494-1450-428a-b50f-7667b5fe10ca tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:12.795768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ffd5d494-1450-428a-b50f-7667b5fe10ca tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:12.796232 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ffd5d494-1450-428a-b50f-7667b5fe10ca tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:12.797014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ffd5d494-1450-428a-b50f-7667b5fe10ca tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:12.797497 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ffd5d494-1450-428a-b50f-7667b5fe10ca tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:13.107961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ffd5d494-1450-428a-b50f-7667b5fe10ca tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:13.115301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ffd5d494-1450-428a-b50f-7667b5fe10ca tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.331011 May 27 09:46:13.115865 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 391/775] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:12 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:14.133805 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8ef6129d-5793-498e-adaa-363d7392dd8f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:14.134522 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8ef6129d-5793-498e-adaa-363d7392dd8f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:14.140739 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8ef6129d-5793-498e-adaa-363d7392dd8f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:14.141188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8ef6129d-5793-498e-adaa-363d7392dd8f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:14.141946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8ef6129d-5793-498e-adaa-363d7392dd8f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:14.142376 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8ef6129d-5793-498e-adaa-363d7392dd8f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:14.208718 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-9d7cbd37-385d-40c8-9b1c-034aa71eacb7 req-81098896-99b0-49a2-be8b-4f30b5928888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4572f19b-c60d-461e-8eec-9c9f8a25201c", "tag": "be291203-ca93-4891-adc1-934c52d11bd3"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:14.217501 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-9d7cbd37-385d-40c8-9b1c-034aa71eacb7 req-81098896-99b0-49a2-be8b-4f30b5928888 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:14.217939 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-9d7cbd37-385d-40c8-9b1c-034aa71eacb7 req-81098896-99b0-49a2-be8b-4f30b5928888 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:14.228768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-9d7cbd37-385d-40c8-9b1c-034aa71eacb7 req-81098896-99b0-49a2-be8b-4f30b5928888 service nova] Creating event network-changed:be291203-ca93-4891-adc1-934c52d11bd3 for instance 4572f19b-c60d-461e-8eec-9c9f8a25201c on hv-cinder-79760 May 27 09:46:14.233878 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-9d7cbd37-385d-40c8-9b1c-034aa71eacb7 req-81098896-99b0-49a2-be8b-4f30b5928888 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028669 May 27 09:46:14.234532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 392/776] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:46:14.274440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8ef6129d-5793-498e-adaa-363d7392dd8f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:14.282502 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8ef6129d-5793-498e-adaa-363d7392dd8f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.152874 May 27 09:46:14.283070 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 385/777] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:14 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:15.300564 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b0484ae0-65e9-43af-a820-6e369725d661 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:15.301258 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b0484ae0-65e9-43af-a820-6e369725d661 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:15.307401 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b0484ae0-65e9-43af-a820-6e369725d661 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:15.307850 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b0484ae0-65e9-43af-a820-6e369725d661 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:15.308607 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b0484ae0-65e9-43af-a820-6e369725d661 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:15.309104 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b0484ae0-65e9-43af-a820-6e369725d661 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:15.438919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b0484ae0-65e9-43af-a820-6e369725d661 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:15.446562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b0484ae0-65e9-43af-a820-6e369725d661 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.150681 May 27 09:46:15.447124 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 393/778] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:15 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:16.464244 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-af082abe-c423-4c76-b953-3efa9b72281c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:16.464858 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-af082abe-c423-4c76-b953-3efa9b72281c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:16.472298 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-af082abe-c423-4c76-b953-3efa9b72281c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:16.472703 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-af082abe-c423-4c76-b953-3efa9b72281c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:16.473470 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-af082abe-c423-4c76-b953-3efa9b72281c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:16.473915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-af082abe-c423-4c76-b953-3efa9b72281c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:16.477853 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:16.611166 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-af082abe-c423-4c76-b953-3efa9b72281c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:16.618528 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-af082abe-c423-4c76-b953-3efa9b72281c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.158238 May 27 09:46:16.619089 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 386/779] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:16 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:17.636168 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-daaff12e-0e39-4968-8419-7f8f38a21843 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:17.636775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-daaff12e-0e39-4968-8419-7f8f38a21843 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:17.643443 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-daaff12e-0e39-4968-8419-7f8f38a21843 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:17.643888 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-daaff12e-0e39-4968-8419-7f8f38a21843 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:17.644647 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-daaff12e-0e39-4968-8419-7f8f38a21843 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:17.645080 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-daaff12e-0e39-4968-8419-7f8f38a21843 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:17.771735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-daaff12e-0e39-4968-8419-7f8f38a21843 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:17.779169 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-daaff12e-0e39-4968-8419-7f8f38a21843 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1677 microversion: 2.1 time: 0.147006 May 27 09:46:17.779766 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 394/780] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:17 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:18.796252 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-81c88f8e-b129-45fd-aee1-014eda49ca07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:18.796859 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-81c88f8e-b129-45fd-aee1-014eda49ca07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:18.803998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-81c88f8e-b129-45fd-aee1-014eda49ca07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:18.804446 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-81c88f8e-b129-45fd-aee1-014eda49ca07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:18.805298 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-81c88f8e-b129-45fd-aee1-014eda49ca07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:18.805734 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-81c88f8e-b129-45fd-aee1-014eda49ca07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:18.936337 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-81c88f8e-b129-45fd-aee1-014eda49ca07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:18.944521 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-81c88f8e-b129-45fd-aee1-014eda49ca07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1654 microversion: 2.1 time: 0.152142 May 27 09:46:18.945338 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 387/781] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:18 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:18.962672 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bb1550b5-4004-480c-9cb7-6ee53f0ffd6e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:18.970010 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bb1550b5-4004-480c-9cb7-6ee53f0ffd6e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:18.970473 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bb1550b5-4004-480c-9cb7-6ee53f0ffd6e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:18.991260 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bb1550b5-4004-480c-9cb7-6ee53f0ffd6e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Going to try to start instance {{(pid=129290) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 09:46:19.030414 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bb1550b5-4004-480c-9cb7-6ee53f0ffd6e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/action" status: 202 len: 0 microversion: 2.1 time: 0.071524 May 27 09:46:19.031908 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 395/782] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:46:18 2022] POST /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:46:19.039110 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f7808b53-392f-47b5-ae36-a0c0cd1df6b4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:19.039753 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f7808b53-392f-47b5-ae36-a0c0cd1df6b4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:19.045713 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f7808b53-392f-47b5-ae36-a0c0cd1df6b4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:19.046163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f7808b53-392f-47b5-ae36-a0c0cd1df6b4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:19.047231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f7808b53-392f-47b5-ae36-a0c0cd1df6b4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:19.047549 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f7808b53-392f-47b5-ae36-a0c0cd1df6b4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:19.178642 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f7808b53-392f-47b5-ae36-a0c0cd1df6b4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:19.186278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f7808b53-392f-47b5-ae36-a0c0cd1df6b4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1663 microversion: 2.1 time: 0.151009 May 27 09:46:19.186840 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 388/783] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:19 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:20.205109 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-61961ced-2d16-4b3f-8714-0fada585ab0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:20.205794 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-61961ced-2d16-4b3f-8714-0fada585ab0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:20.211982 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-61961ced-2d16-4b3f-8714-0fada585ab0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:20.212432 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-61961ced-2d16-4b3f-8714-0fada585ab0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:20.213214 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-61961ced-2d16-4b3f-8714-0fada585ab0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:20.213645 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-61961ced-2d16-4b3f-8714-0fada585ab0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:20.341121 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-61961ced-2d16-4b3f-8714-0fada585ab0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:20.349045 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-61961ced-2d16-4b3f-8714-0fada585ab0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1663 microversion: 2.1 time: 0.148638 May 27 09:46:20.349597 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 396/784] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:20 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:21.366203 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-105f9f7f-93e4-4eae-a6e3-b4261460fb0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:21.366723 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-105f9f7f-93e4-4eae-a6e3-b4261460fb0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:21.373433 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-105f9f7f-93e4-4eae-a6e3-b4261460fb0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:21.373886 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-105f9f7f-93e4-4eae-a6e3-b4261460fb0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:21.374649 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-105f9f7f-93e4-4eae-a6e3-b4261460fb0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:21.375088 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-105f9f7f-93e4-4eae-a6e3-b4261460fb0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:21.506561 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-105f9f7f-93e4-4eae-a6e3-b4261460fb0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:21.513953 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-105f9f7f-93e4-4eae-a6e3-b4261460fb0e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1667 microversion: 2.1 time: 0.151650 May 27 09:46:21.514518 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 389/785] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:21 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:46:33.125849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-156f3170-d7bc-402e-b18b-504ec170a455 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:33.126353 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-156f3170-d7bc-402e-b18b-504ec170a455 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:33.128945 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=21 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:33.129603 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:33.135633 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-156f3170-d7bc-402e-b18b-504ec170a455 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:33.136085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-156f3170-d7bc-402e-b18b-504ec170a455 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.136850 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-156f3170-d7bc-402e-b18b-504ec170a455 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:33.137285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-156f3170-d7bc-402e-b18b-504ec170a455 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.168162 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-156f3170-d7bc-402e-b18b-504ec170a455 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments/bfc49896-76af-4726-b262-a819a713522a" status: 200 len: 194 microversion: 2.20 time: 0.046225 May 27 09:46:33.168777 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 397/786] 10.222.0.41 () {60 vars in 1453 bytes} [Fri May 27 09:46:33 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments/bfc49896-76af-4726-b262-a819a713522a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:46:33.231085 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-30e30b78-6ff6-4be6-9867-09ef0a9b4390 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:33.231652 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-30e30b78-6ff6-4be6-9867-09ef0a9b4390 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:33.234013 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=23 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:33.234802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=23 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:33.240445 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30e30b78-6ff6-4be6-9867-09ef0a9b4390 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:33.240897 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30e30b78-6ff6-4be6-9867-09ef0a9b4390 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.241698 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30e30b78-6ff6-4be6-9867-09ef0a9b4390 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:33.242137 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30e30b78-6ff6-4be6-9867-09ef0a9b4390 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.321374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-30e30b78-6ff6-4be6-9867-09ef0a9b4390 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lazy-loading 'services' on Instance uuid c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:46:33.391032 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-30e30b78-6ff6-4be6-9867-09ef0a9b4390 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments/bfc49896-76af-4726-b262-a819a713522a" status: 202 len: 0 microversion: 2.20 time: 0.163671 May 27 09:46:33.391708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 390/787] 10.222.0.41 () {60 vars in 1456 bytes} [Fri May 27 09:46:33 2022] DELETE /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments/bfc49896-76af-4726-b262-a819a713522a => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 09:46:33.400583 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-577eeb67-5a9f-4879-b845-e7711833f4fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:33.401913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-577eeb67-5a9f-4879-b845-e7711833f4fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:33.407712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-577eeb67-5a9f-4879-b845-e7711833f4fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:33.408092 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-577eeb67-5a9f-4879-b845-e7711833f4fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.408922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-577eeb67-5a9f-4879-b845-e7711833f4fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:33.409371 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-577eeb67-5a9f-4879-b845-e7711833f4fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.438769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-577eeb67-5a9f-4879-b845-e7711833f4fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042153 May 27 09:46:33.439342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 398/788] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 09:46:33 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:46:34.451493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4f3ae439-0235-49ed-be8f-29c6970c7375 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:34.452587 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4f3ae439-0235-49ed-be8f-29c6970c7375 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:34.459958 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f3ae439-0235-49ed-be8f-29c6970c7375 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:34.460454 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f3ae439-0235-49ed-be8f-29c6970c7375 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:34.461271 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f3ae439-0235-49ed-be8f-29c6970c7375 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:34.461746 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4f3ae439-0235-49ed-be8f-29c6970c7375 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:34.490482 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4f3ae439-0235-49ed-be8f-29c6970c7375 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043371 May 27 09:46:34.491042 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 391/789] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 09:46:34 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:46:35.502799 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a2da3b2f-3c02-462c-8e91-02ec64373a2a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:35.503663 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a2da3b2f-3c02-462c-8e91-02ec64373a2a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:35.510077 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a2da3b2f-3c02-462c-8e91-02ec64373a2a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:35.510519 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a2da3b2f-3c02-462c-8e91-02ec64373a2a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:35.511270 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a2da3b2f-3c02-462c-8e91-02ec64373a2a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:35.511721 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a2da3b2f-3c02-462c-8e91-02ec64373a2a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:35.538802 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a2da3b2f-3c02-462c-8e91-02ec64373a2a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040676 May 27 09:46:35.539352 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 399/790] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 09:46:35 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:35.595748 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2ab76da1-cbc5-48f2-867c-ca766077858c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:35.596240 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2ab76da1-cbc5-48f2-867c-ca766077858c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:35.602536 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ab76da1-cbc5-48f2-867c-ca766077858c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:35.602982 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ab76da1-cbc5-48f2-867c-ca766077858c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:35.603773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ab76da1-cbc5-48f2-867c-ca766077858c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:35.604203 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2ab76da1-cbc5-48f2-867c-ca766077858c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:35.630663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2ab76da1-cbc5-48f2-867c-ca766077858c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:46:35.702523 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2ab76da1-cbc5-48f2-867c-ca766077858c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 204 len: 0 microversion: 2.20 time: 0.110255 May 27 09:46:35.703378 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 392/791] 10.222.0.41 () {60 vars in 1279 bytes} [Fri May 27 09:46:35 2022] DELETE /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 09:46:35.712324 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-16b7095d-d02f-48f6-8249-d9276686d1bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:35.713573 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-16b7095d-d02f-48f6-8249-d9276686d1bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:35.719996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-16b7095d-d02f-48f6-8249-d9276686d1bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:35.720452 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-16b7095d-d02f-48f6-8249-d9276686d1bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:35.721709 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-16b7095d-d02f-48f6-8249-d9276686d1bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:35.722147 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-16b7095d-d02f-48f6-8249-d9276686d1bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:35.848145 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-16b7095d-d02f-48f6-8249-d9276686d1bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:35.855986 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-16b7095d-d02f-48f6-8249-d9276686d1bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:35.857491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-16b7095d-d02f-48f6-8249-d9276686d1bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:35.858637 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-16b7095d-d02f-48f6-8249-d9276686d1bf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.150413 May 27 09:46:35.859223 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 400/792] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:35 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:36.879216 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-371aef3e-4ccc-4407-b4d4-1fd9ef7fdea1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:36.879930 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-371aef3e-4ccc-4407-b4d4-1fd9ef7fdea1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:36.886444 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-371aef3e-4ccc-4407-b4d4-1fd9ef7fdea1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:36.886896 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-371aef3e-4ccc-4407-b4d4-1fd9ef7fdea1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:36.887694 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-371aef3e-4ccc-4407-b4d4-1fd9ef7fdea1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:36.888135 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-371aef3e-4ccc-4407-b4d4-1fd9ef7fdea1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:37.016265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-371aef3e-4ccc-4407-b4d4-1fd9ef7fdea1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:37.024060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-371aef3e-4ccc-4407-b4d4-1fd9ef7fdea1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:37.025565 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-371aef3e-4ccc-4407-b4d4-1fd9ef7fdea1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:37.026725 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-371aef3e-4ccc-4407-b4d4-1fd9ef7fdea1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.152476 May 27 09:46:37.027292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 393/793] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:36 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:38.045094 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ed0dafbe-18f8-4f15-ad89-7147d4db40ed tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:38.045705 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ed0dafbe-18f8-4f15-ad89-7147d4db40ed tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:38.052194 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ed0dafbe-18f8-4f15-ad89-7147d4db40ed tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:38.052642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ed0dafbe-18f8-4f15-ad89-7147d4db40ed tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:38.053413 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ed0dafbe-18f8-4f15-ad89-7147d4db40ed tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:38.053853 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ed0dafbe-18f8-4f15-ad89-7147d4db40ed tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:38.321515 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ed0dafbe-18f8-4f15-ad89-7147d4db40ed tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:38.329478 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ed0dafbe-18f8-4f15-ad89-7147d4db40ed tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:38.331036 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ed0dafbe-18f8-4f15-ad89-7147d4db40ed tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:38.332219 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ed0dafbe-18f8-4f15-ad89-7147d4db40ed tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1722 microversion: 2.20 time: 0.291111 May 27 09:46:38.332778 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 401/794] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:38 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:38.907020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-e6bcbd70-8b58-4f98-9557-bec330d554c5 req-0f0c1997-aacd-4eae-8397-6e2f92d7a2af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7937af8-bbeb-4a70-bd98-1062cbe0d4c7", "name": "network-vif-deleted", "tag": "6328b701-4055-487d-8cef-ec0bdfa4ceda"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:38.922574 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-e6bcbd70-8b58-4f98-9557-bec330d554c5 req-0f0c1997-aacd-4eae-8397-6e2f92d7a2af service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:38.923019 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-e6bcbd70-8b58-4f98-9557-bec330d554c5 req-0f0c1997-aacd-4eae-8397-6e2f92d7a2af service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:38.935132 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-e6bcbd70-8b58-4f98-9557-bec330d554c5 req-0f0c1997-aacd-4eae-8397-6e2f92d7a2af service nova] Creating event network-vif-deleted:6328b701-4055-487d-8cef-ec0bdfa4ceda for instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 on hv-cinder-79760 May 27 09:46:38.940129 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-e6bcbd70-8b58-4f98-9557-bec330d554c5 req-0f0c1997-aacd-4eae-8397-6e2f92d7a2af service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040799 May 27 09:46:38.943627 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 394/795] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:39.351172 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:39.351822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:39.358622 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:39.359064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:39.359862 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:39.360294 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:39.391628 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:39.393040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:39.393711 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lazy-loading 'fault' on Instance uuid c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:46:39.436947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:39.450333 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:39.452856 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:39.454026 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9cd7db38-edad-4b7c-84ea-a2bc7453a63e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 200 len: 1371 microversion: 2.20 time: 0.106706 May 27 09:46:39.454580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 402/796] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:39 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:40.474395 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-96f1b332-ff96-40fc-95ab-8262bea83935 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:40.475092 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-96f1b332-ff96-40fc-95ab-8262bea83935 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:40.481268 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-96f1b332-ff96-40fc-95ab-8262bea83935 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:40.481725 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-96f1b332-ff96-40fc-95ab-8262bea83935 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:40.482492 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-96f1b332-ff96-40fc-95ab-8262bea83935 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:40.482931 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-96f1b332-ff96-40fc-95ab-8262bea83935 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:40.496592 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-96f1b332-ff96-40fc-95ab-8262bea83935 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] HTTP exception thrown: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-96f1b332-ff96-40fc-95ab-8262bea83935 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Request method failure captured: May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 HTTP/1.1 May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJw5EXjX8LWOR8bY7cVtutIr3ut5ZjUPwezeUUgcPqFbRCWaMsW1gFI6VV_uTtxJ5eV9bFz4hXnlsQnVIykcWOla6y8sjkM9lnjcjNWN4gSEwP_UOvLsVD10-bFaNt2uVhzA1d9dcffu7abGWtddEF6xxNOyjX2vIx3L7S-q8Uz6ueo May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:46:40.498218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fbb8746f17d6410f9c82d0fde348d1f9"}]}] May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 5b0d25ff6a664177b463b834124802d5 May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:46:40.499905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'c7937af8-bbeb-4a70-bd98-1062cbe0d4c7'} May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:46:40.501159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:46:40.503226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:46:40.504888 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-96f1b332-ff96-40fc-95ab-8262bea83935 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Returning 404 to user: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:46:40.504888 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-96f1b332-ff96-40fc-95ab-8262bea83935 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 404 len: 111 microversion: 2.20 time: 0.030046 May 27 09:46:40.504888 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 395/797] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:40 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 09:46:40.510455 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2f832bf3-b255-4ce5-a294-e51daa485ad7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '.version_select at 0x7f188c0d8790>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:40.530969 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2f832bf3-b255-4ce5-a294-e51daa485ad7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-516210192" status: 204 len: 0 microversion: 2.20 time: 0.024569 May 27 09:46:40.531570 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 403/798] 10.222.0.41 () {60 vars in 1258 bytes} [Fri May 27 09:46:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-516210192 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 09:46:41.209020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ec3fd9f9-2b0a-4e05-bbd7-95f3b6d986e0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'create', calling method: .version_select at 0x7f188c342dc0>, body: {"keypair": {"name": "tempest-keypair-1782480409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdhA9FgH6HllAOhJDH3zoogiUA7HE14Zg/m/3wTVth35WoAGAiiWSy5d2cvvrpymSQvgbQNEZYNmoKbyexqn8REFxCwa5mHp5ZlTPPEMiLjuq9UZzA1Nl4OhXO2OQo4Lg=="}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:41.223348 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-ec3fd9f9-2b0a-4e05-bbd7-95f3b6d986e0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Getting quotas for project fbb8746f17d6410f9c82d0fde348d1f9. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:46:41.227216 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-ec3fd9f9-2b0a-4e05-bbd7-95f3b6d986e0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Getting quotas for user 5b0d25ff6a664177b463b834124802d5 and project fbb8746f17d6410f9c82d0fde348d1f9. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:46:41.248750 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ec3fd9f9-2b0a-4e05-bbd7-95f3b6d986e0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043666 May 27 09:46:41.249370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 396/799] 10.222.0.41 () {62 vars in 1199 bytes} [Fri May 27 09:46:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 09:46:42.554723 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-437468009", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90d3a2be-1adb-43f3-aa78-1e534bd2671b"}], "security_groups": [{"name": "tempest-securitygroup--233568685"}], "key_name": "tempest-keypair-1782480409", "user_data": "}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:42.654257 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] validate_networks() for [('90d3a2be-1adb-43f3-aa78-1e534bd2671b', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:46:43.051614 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:46:43.052210 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:46:43.052658 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:46:43.053064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:46:43.053500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:46:43.062227 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:43.062672 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:43.063512 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:43.063958 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:43.080748 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Getting quotas for project fbb8746f17d6410f9c82d0fde348d1f9. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:46:43.084623 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Getting quotas for user 5b0d25ff6a664177b463b834124802d5 and project fbb8746f17d6410f9c82d0fde348d1f9. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:46:43.095681 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:46:43.097924 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:46:43.143217 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3c4082ec-713d-403e-80a0-b581d0fef388 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.592839 May 27 09:46:43.143879 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 404/800] 10.222.0.41 () {62 vars in 1187 bytes} [Fri May 27 09:46:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 09:46:43.153794 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5d33cb3d-75fd-4d8d-9e5e-c1c75102f292 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:43.154402 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5d33cb3d-75fd-4d8d-9e5e-c1c75102f292 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:43.209676 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5d33cb3d-75fd-4d8d-9e5e-c1c75102f292 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:43.217133 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5d33cb3d-75fd-4d8d-9e5e-c1c75102f292 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:43.218636 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5d33cb3d-75fd-4d8d-9e5e-c1c75102f292 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:43.219814 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5d33cb3d-75fd-4d8d-9e5e-c1c75102f292 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1281 microversion: 2.20 time: 0.069869 May 27 09:46:43.221267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 397/801] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:43 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:44.238663 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-18312ff7-a91d-4800-a5c2-23c61a3992d0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:44.239259 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-18312ff7-a91d-4800-a5c2-23c61a3992d0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:44.245976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18312ff7-a91d-4800-a5c2-23c61a3992d0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:44.246426 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18312ff7-a91d-4800-a5c2-23c61a3992d0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:44.247411 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18312ff7-a91d-4800-a5c2-23c61a3992d0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:44.247851 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-18312ff7-a91d-4800-a5c2-23c61a3992d0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:44.321762 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-18312ff7-a91d-4800-a5c2-23c61a3992d0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:44.330547 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-18312ff7-a91d-4800-a5c2-23c61a3992d0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:44.332148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-18312ff7-a91d-4800-a5c2-23c61a3992d0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:44.333262 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-18312ff7-a91d-4800-a5c2-23c61a3992d0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1351 microversion: 2.20 time: 0.099083 May 27 09:46:44.333984 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 405/802] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:44 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:45.351792 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-abf92b2f-a82b-4d5c-9c2a-d5ac753a8676 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:45.352319 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-abf92b2f-a82b-4d5c-9c2a-d5ac753a8676 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:45.358761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-abf92b2f-a82b-4d5c-9c2a-d5ac753a8676 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:45.359210 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-abf92b2f-a82b-4d5c-9c2a-d5ac753a8676 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:45.360037 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-abf92b2f-a82b-4d5c-9c2a-d5ac753a8676 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:45.360474 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-abf92b2f-a82b-4d5c-9c2a-d5ac753a8676 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:45.813976 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-abf92b2f-a82b-4d5c-9c2a-d5ac753a8676 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:45.821888 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-abf92b2f-a82b-4d5c-9c2a-d5ac753a8676 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:45.823435 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-abf92b2f-a82b-4d5c-9c2a-d5ac753a8676 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:45.824668 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-abf92b2f-a82b-4d5c-9c2a-d5ac753a8676 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1406 microversion: 2.20 time: 0.476742 May 27 09:46:45.825298 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 398/803] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:45 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:45.955153 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-76ed5dc7-d622-4abc-8d12-e4afc9b0fd85 req-83ffab7e-ee13-4fca-96c7-d2e71bb068e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330ed71b-ab48-42b7-b46e-98be00f7343e", "tag": "9011439f-1b54-4948-87ab-dd7cd4f186e5"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:45.965009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-76ed5dc7-d622-4abc-8d12-e4afc9b0fd85 req-83ffab7e-ee13-4fca-96c7-d2e71bb068e8 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:45.966037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-76ed5dc7-d622-4abc-8d12-e4afc9b0fd85 req-83ffab7e-ee13-4fca-96c7-d2e71bb068e8 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:45.983715 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-76ed5dc7-d622-4abc-8d12-e4afc9b0fd85 req-83ffab7e-ee13-4fca-96c7-d2e71bb068e8 service nova] Creating event network-changed:9011439f-1b54-4948-87ab-dd7cd4f186e5 for instance 330ed71b-ab48-42b7-b46e-98be00f7343e on hv-cinder-79760 May 27 09:46:45.989163 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-76ed5dc7-d622-4abc-8d12-e4afc9b0fd85 req-83ffab7e-ee13-4fca-96c7-d2e71bb068e8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039344 May 27 09:46:45.990379 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 406/804] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:46:46.842632 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-bed1ce63-d654-4ae0-b8b1-8defa7ce16fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:46.843245 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bed1ce63-d654-4ae0-b8b1-8defa7ce16fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:46.850369 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bed1ce63-d654-4ae0-b8b1-8defa7ce16fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:46.850826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bed1ce63-d654-4ae0-b8b1-8defa7ce16fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:46.851620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bed1ce63-d654-4ae0-b8b1-8defa7ce16fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:46.852060 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bed1ce63-d654-4ae0-b8b1-8defa7ce16fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:46.985215 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bed1ce63-d654-4ae0-b8b1-8defa7ce16fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:46.993011 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bed1ce63-d654-4ae0-b8b1-8defa7ce16fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:46.994502 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bed1ce63-d654-4ae0-b8b1-8defa7ce16fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:46.995626 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-bed1ce63-d654-4ae0-b8b1-8defa7ce16fa tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1406 microversion: 2.20 time: 0.157170 May 27 09:46:46.996188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 399/805] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:46 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:47.256683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-22182345-3a7a-447f-be71-2a56c977bf5f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-288229352"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:47.257565 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-22182345-3a7a-447f-be71-2a56c977bf5f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:47.263724 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-22182345-3a7a-447f-be71-2a56c977bf5f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:47.264170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-22182345-3a7a-447f-be71-2a56c977bf5f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:47.264925 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-22182345-3a7a-447f-be71-2a56c977bf5f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:47.265367 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-22182345-3a7a-447f-be71-2a56c977bf5f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:47.389917 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.network.security_group_api [None req-22182345-3a7a-447f-be71-2a56c977bf5f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Removing security group baed0279-8398-4064-89ca-32033c6b1482 from port 7adfbb2e-f976-47e6-8ad5-c96c45292acc May 27 09:46:47.766204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-22182345-3a7a-447f-be71-2a56c977bf5f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "POST /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/action" status: 202 len: 0 microversion: 2.1 time: 0.619687 May 27 09:46:47.771731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 407/806] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:46:47 2022] POST /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:46:48.012332 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-5d60db1a-ceda-4275-bf29-6843d20b188d req-5935bcee-d7ee-45ee-a326-82e1e16fc2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd942627-ce67-4a65-95dc-a589397bd130", "tag": "7adfbb2e-f976-47e6-8ad5-c96c45292acc"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:48.015257 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-738bf258-f420-438a-b6fc-9c1007901f6d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:48.015895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-738bf258-f420-438a-b6fc-9c1007901f6d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:48.023104 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-738bf258-f420-438a-b6fc-9c1007901f6d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:48.023747 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-5d60db1a-ceda-4275-bf29-6843d20b188d req-5935bcee-d7ee-45ee-a326-82e1e16fc2d4 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:48.023987 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-738bf258-f420-438a-b6fc-9c1007901f6d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:48.024410 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-5d60db1a-ceda-4275-bf29-6843d20b188d req-5935bcee-d7ee-45ee-a326-82e1e16fc2d4 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:48.025109 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-738bf258-f420-438a-b6fc-9c1007901f6d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:48.025707 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-738bf258-f420-438a-b6fc-9c1007901f6d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:48.038481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-5d60db1a-ceda-4275-bf29-6843d20b188d req-5935bcee-d7ee-45ee-a326-82e1e16fc2d4 service nova] Creating event network-changed:7adfbb2e-f976-47e6-8ad5-c96c45292acc for instance cd942627-ce67-4a65-95dc-a589397bd130 on hv-cinder-79760 May 27 09:46:48.045138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-5d60db1a-ceda-4275-bf29-6843d20b188d req-5935bcee-d7ee-45ee-a326-82e1e16fc2d4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039581 May 27 09:46:48.047264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 400/807] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:48.251175 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-738bf258-f420-438a-b6fc-9c1007901f6d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:48.262142 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-738bf258-f420-438a-b6fc-9c1007901f6d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:48.263893 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-738bf258-f420-438a-b6fc-9c1007901f6d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:48.265133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-738bf258-f420-438a-b6fc-9c1007901f6d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1406 microversion: 2.20 time: 0.255131 May 27 09:46:48.265911 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 408/808] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:48 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:48.893711 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-db4fc6f1-ec22-49d3-a5a6-5554919be1bc tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:48.894282 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-db4fc6f1-ec22-49d3-a5a6-5554919be1bc tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:48.900462 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-db4fc6f1-ec22-49d3-a5a6-5554919be1bc tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:48.900909 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-db4fc6f1-ec22-49d3-a5a6-5554919be1bc tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:48.901665 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-db4fc6f1-ec22-49d3-a5a6-5554919be1bc tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:48.902095 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-db4fc6f1-ec22-49d3-a5a6-5554919be1bc tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:48.985388 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-db4fc6f1-ec22-49d3-a5a6-5554919be1bc tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lazy-loading 'services' on Instance uuid cd942627-ce67-4a65-95dc-a589397bd130 {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:46:49.060896 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-db4fc6f1-ec22-49d3-a5a6-5554919be1bc tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments/fab9bddd-6996-4e07-8d48-31b384400539" status: 202 len: 0 microversion: 2.1 time: 0.171884 May 27 09:46:49.061874 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 401/809] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:46:48 2022] DELETE /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments/fab9bddd-6996-4e07-8d48-31b384400539 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 09:46:49.069873 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7905cb1f-988d-4cb1-b894-52e4f0dac1cb tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:49.070855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7905cb1f-988d-4cb1-b894-52e4f0dac1cb tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:49.076785 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7905cb1f-988d-4cb1-b894-52e4f0dac1cb tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:49.077231 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7905cb1f-988d-4cb1-b894-52e4f0dac1cb tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:49.078028 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7905cb1f-988d-4cb1-b894-52e4f0dac1cb tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:49.078461 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7905cb1f-988d-4cb1-b894-52e4f0dac1cb tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:49.108137 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7905cb1f-988d-4cb1-b894-52e4f0dac1cb tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 May 27 09:46:49.108683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 409/810] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:46:49 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:49.284402 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c7d3d53e-70d3-40af-b5b4-3d3c1e0c0612 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:49.285101 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c7d3d53e-70d3-40af-b5b4-3d3c1e0c0612 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:49.291446 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c7d3d53e-70d3-40af-b5b4-3d3c1e0c0612 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:49.291895 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c7d3d53e-70d3-40af-b5b4-3d3c1e0c0612 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:49.292660 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c7d3d53e-70d3-40af-b5b4-3d3c1e0c0612 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:49.293096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c7d3d53e-70d3-40af-b5b4-3d3c1e0c0612 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:49.422305 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c7d3d53e-70d3-40af-b5b4-3d3c1e0c0612 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:49.430274 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c7d3d53e-70d3-40af-b5b4-3d3c1e0c0612 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:49.431985 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c7d3d53e-70d3-40af-b5b4-3d3c1e0c0612 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:49.433100 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c7d3d53e-70d3-40af-b5b4-3d3c1e0c0612 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1406 microversion: 2.20 time: 0.153023 May 27 09:46:49.433667 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 402/811] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:49 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:50.061546 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-d5bffeb4-43f1-420a-aed3-8d981357c748 req-5fbc810d-60ed-4833-a07d-093a9626cc7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd942627-ce67-4a65-95dc-a589397bd130", "tag": "7adfbb2e-f976-47e6-8ad5-c96c45292acc"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:50.070075 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-d5bffeb4-43f1-420a-aed3-8d981357c748 req-5fbc810d-60ed-4833-a07d-093a9626cc7b service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:50.070468 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-d5bffeb4-43f1-420a-aed3-8d981357c748 req-5fbc810d-60ed-4833-a07d-093a9626cc7b service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:50.081105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-d5bffeb4-43f1-420a-aed3-8d981357c748 req-5fbc810d-60ed-4833-a07d-093a9626cc7b service nova] Creating event network-changed:7adfbb2e-f976-47e6-8ad5-c96c45292acc for instance cd942627-ce67-4a65-95dc-a589397bd130 on hv-cinder-79760 May 27 09:46:50.085996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-d5bffeb4-43f1-420a-aed3-8d981357c748 req-5fbc810d-60ed-4833-a07d-093a9626cc7b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028075 May 27 09:46:50.086549 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 410/812] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:50.119806 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-567901d9-26fe-4cf7-8e38-4392ffd0c1c2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:50.120759 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-567901d9-26fe-4cf7-8e38-4392ffd0c1c2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:50.127247 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-567901d9-26fe-4cf7-8e38-4392ffd0c1c2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:50.127727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-567901d9-26fe-4cf7-8e38-4392ffd0c1c2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:50.128489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-567901d9-26fe-4cf7-8e38-4392ffd0c1c2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:50.128921 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-567901d9-26fe-4cf7-8e38-4392ffd0c1c2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:50.158081 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-567901d9-26fe-4cf7-8e38-4392ffd0c1c2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 May 27 09:46:50.158635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 403/813] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:46:50 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:50.452558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1a0bc51f-adf0-4fa1-bcd4-47cab4ad7887 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:50.453273 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1a0bc51f-adf0-4fa1-bcd4-47cab4ad7887 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:50.460132 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a0bc51f-adf0-4fa1-bcd4-47cab4ad7887 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:50.460578 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a0bc51f-adf0-4fa1-bcd4-47cab4ad7887 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:50.461339 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a0bc51f-adf0-4fa1-bcd4-47cab4ad7887 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:50.461770 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1a0bc51f-adf0-4fa1-bcd4-47cab4ad7887 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:50.770623 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1a0bc51f-adf0-4fa1-bcd4-47cab4ad7887 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:50.779717 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1a0bc51f-adf0-4fa1-bcd4-47cab4ad7887 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:50.781738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1a0bc51f-adf0-4fa1-bcd4-47cab4ad7887 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:50.783968 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1a0bc51f-adf0-4fa1-bcd4-47cab4ad7887 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1406 microversion: 2.20 time: 0.335965 May 27 09:46:50.784608 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 411/814] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:50 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:51.170572 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ee1c62f5-05c5-40ad-b00c-0bafefe390d6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:51.172157 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ee1c62f5-05c5-40ad-b00c-0bafefe390d6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:51.179384 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ee1c62f5-05c5-40ad-b00c-0bafefe390d6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:51.179843 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ee1c62f5-05c5-40ad-b00c-0bafefe390d6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:51.180798 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ee1c62f5-05c5-40ad-b00c-0bafefe390d6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:51.181238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ee1c62f5-05c5-40ad-b00c-0bafefe390d6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:51.209832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ee1c62f5-05c5-40ad-b00c-0bafefe390d6 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043974 May 27 09:46:51.210402 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 404/815] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:46:51 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:46:51.220281 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a2a91ae2-1ec2-4d88-8a28-6ee5ca07d2b2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:51.220803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a2a91ae2-1ec2-4d88-8a28-6ee5ca07d2b2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:51.227214 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a2a91ae2-1ec2-4d88-8a28-6ee5ca07d2b2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:51.227709 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a2a91ae2-1ec2-4d88-8a28-6ee5ca07d2b2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:51.228478 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a2a91ae2-1ec2-4d88-8a28-6ee5ca07d2b2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:51.228923 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a2a91ae2-1ec2-4d88-8a28-6ee5ca07d2b2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:51.303822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-a2a91ae2-1ec2-4d88-8a28-6ee5ca07d2b2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] HTTP exception thrown: Instance cd942627-ce67-4a65-95dc-a589397bd130 is not attached to volume fab9bddd-6996-4e07-8d48-31b384400539 May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a2a91ae2-1ec2-4d88-8a28-6ee5ca07d2b2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Request method failure captured: May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: DELETE /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments/fab9bddd-6996-4e07-8d48-31b384400539 HTTP/1.1 May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJydidDeRFOa5o5fj4jIcdPpHbImrUVcA5ZQzXbkxf8BfDIdDtSVUqgsIm8PKPj5qNU7lYJk9SUXc2CeQawc61s49KNDARJZaW2vAuHStqMUPGyF-QYSo6s8Cpxb8LZhjms6fPV8ltOelx-HOuQ54kEWagvq8W_FVHI7vmRNrCt0MA0 May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 050fc8655bd34646b1b3f211b6fd912a May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-TestMinimumBasicScenario-288821078 May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:46:51.310890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/050fc8655bd34646b1b3f211b6fd912a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/050fc8655bd34646b1b3f211b6fd912a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/050fc8655bd34646b1b3f211b6fd912a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_050fc8655bd34646b1b3f211b6fd912a"}]}] May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-TestMinimumBasicScenario-288821078 May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 050fc8655bd34646b1b3f211b6fd912a May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-TestMinimumBasicScenario-288821078 May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-TestMinimumBasicScenario-288821078-project May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 68b32d9217954d72a2b7aa3ba893f942 May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-TestMinimumBasicScenario-288821078-project May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:46:51.312482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance cd942627-ce67-4a65-95dc-a589397bd130 is not attached to volume fab9bddd-6996-4e07-8d48-31b384400539 May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'server_id': 'cd942627-ce67-4a65-95dc-a589397bd130', 'id': 'fab9bddd-6996-4e07-8d48-31b384400539'} May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fab9bddd-6996-4e07-8d48-31b384400539. May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:46:51.313295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd942627-ce67-4a65-95dc-a589397bd130 is not attached to volume fab9bddd-6996-4e07-8d48-31b384400539 May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd942627-ce67-4a65-95dc-a589397bd130 is not attached to volume fab9bddd-6996-4e07-8d48-31b384400539 May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:51.315204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a2a91ae2-1ec2-4d88-8a28-6ee5ca07d2b2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Returning 404 to user: Instance cd942627-ce67-4a65-95dc-a589397bd130 is not attached to volume fab9bddd-6996-4e07-8d48-31b384400539 {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:46:51.316310 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a2a91ae2-1ec2-4d88-8a28-6ee5ca07d2b2 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments/fab9bddd-6996-4e07-8d48-31b384400539" status: 404 len: 154 microversion: 2.1 time: 0.096037 May 27 09:46:51.316310 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 412/816] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:46:51 2022] DELETE /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130/os-volume_attachments/fab9bddd-6996-4e07-8d48-31b384400539 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:46:51.802276 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-08d09ddc-3d77-4977-bee5-7cb392da4172 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:51.802915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-08d09ddc-3d77-4977-bee5-7cb392da4172 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:51.808926 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-08d09ddc-3d77-4977-bee5-7cb392da4172 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:51.809379 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-08d09ddc-3d77-4977-bee5-7cb392da4172 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:51.810160 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-08d09ddc-3d77-4977-bee5-7cb392da4172 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:51.810595 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-08d09ddc-3d77-4977-bee5-7cb392da4172 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:51.943143 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-08d09ddc-3d77-4977-bee5-7cb392da4172 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:51.951006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-08d09ddc-3d77-4977-bee5-7cb392da4172 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:51.952530 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-08d09ddc-3d77-4977-bee5-7cb392da4172 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:51.953634 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-08d09ddc-3d77-4977-bee5-7cb392da4172 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1406 microversion: 2.20 time: 0.155300 May 27 09:46:51.954191 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 405/817] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:51 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:46:52.456102 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ca0d96d5-ae94-4e42-b204-0d8e44a333fa tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:52.456608 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ca0d96d5-ae94-4e42-b204-0d8e44a333fa tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:52.463089 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ca0d96d5-ae94-4e42-b204-0d8e44a333fa tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:52.463584 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ca0d96d5-ae94-4e42-b204-0d8e44a333fa tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:52.464374 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ca0d96d5-ae94-4e42-b204-0d8e44a333fa tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:52.464823 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ca0d96d5-ae94-4e42-b204-0d8e44a333fa tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:52.489360 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ca0d96d5-ae94-4e42-b204-0d8e44a333fa tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Going to try to terminate instance {{(pid=129290) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:46:52.566769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ca0d96d5-ae94-4e42-b204-0d8e44a333fa tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 204 len: 0 microversion: 2.1 time: 0.114920 May 27 09:46:52.567378 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 413/818] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:46:52 2022] DELETE /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:46:52.575462 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3bbf830f-9f86-415b-a512-d7107431c45f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:52.576206 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-3bbf830f-9f86-415b-a512-d7107431c45f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:52.582683 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3bbf830f-9f86-415b-a512-d7107431c45f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:52.583136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3bbf830f-9f86-415b-a512-d7107431c45f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:52.583935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3bbf830f-9f86-415b-a512-d7107431c45f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:52.584376 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3bbf830f-9f86-415b-a512-d7107431c45f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:52.715775 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-3bbf830f-9f86-415b-a512-d7107431c45f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:52.723608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3bbf830f-9f86-415b-a512-d7107431c45f tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1556 microversion: 2.1 time: 0.151962 May 27 09:46:52.724364 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 406/819] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:52 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:46:52.772139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-4af273ea-0a01-4793-abd5-cd99783b90d8 req-ef9c6e30-5fa9-41a5-a3b8-1024a9a426cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330ed71b-ab48-42b7-b46e-98be00f7343e", "name": "network-vif-plugged", "status": "completed", "tag": "9011439f-1b54-4948-87ab-dd7cd4f186e5"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:52.780211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-4af273ea-0a01-4793-abd5-cd99783b90d8 req-ef9c6e30-5fa9-41a5-a3b8-1024a9a426cb service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:52.780852 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-4af273ea-0a01-4793-abd5-cd99783b90d8 req-ef9c6e30-5fa9-41a5-a3b8-1024a9a426cb service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:52.792001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-4af273ea-0a01-4793-abd5-cd99783b90d8 req-ef9c6e30-5fa9-41a5-a3b8-1024a9a426cb service nova] Creating event network-vif-plugged:9011439f-1b54-4948-87ab-dd7cd4f186e5 for instance 330ed71b-ab48-42b7-b46e-98be00f7343e on hv-cinder-79760 May 27 09:46:52.796735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-4af273ea-0a01-4793-abd5-cd99783b90d8 req-ef9c6e30-5fa9-41a5-a3b8-1024a9a426cb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028569 May 27 09:46:52.797331 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 414/820] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:52.972742 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-850f39d9-08cb-42e1-9b81-91246c7e4d58 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:52.973270 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-850f39d9-08cb-42e1-9b81-91246c7e4d58 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:52.979254 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-850f39d9-08cb-42e1-9b81-91246c7e4d58 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:52.979725 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-850f39d9-08cb-42e1-9b81-91246c7e4d58 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:52.980483 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-850f39d9-08cb-42e1-9b81-91246c7e4d58 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:52.981184 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-850f39d9-08cb-42e1-9b81-91246c7e4d58 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:53.000201 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:53.117067 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-850f39d9-08cb-42e1-9b81-91246c7e4d58 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:53.125336 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-850f39d9-08cb-42e1-9b81-91246c7e4d58 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:53.126835 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-850f39d9-08cb-42e1-9b81-91246c7e4d58 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:53.127980 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-850f39d9-08cb-42e1-9b81-91246c7e4d58 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1406 microversion: 2.20 time: 0.159793 May 27 09:46:53.128541 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 407/821] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:52 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:53.738444 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:53.739186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=6 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:53.744024 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4c06f6d4-b611-4030-92c9-8bea8f806635 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:53.744744 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4c06f6d4-b611-4030-92c9-8bea8f806635 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:53.752241 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4c06f6d4-b611-4030-92c9-8bea8f806635 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:53.752683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4c06f6d4-b611-4030-92c9-8bea8f806635 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:53.753434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4c06f6d4-b611-4030-92c9-8bea8f806635 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:53.753862 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4c06f6d4-b611-4030-92c9-8bea8f806635 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:53.773052 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:53.883622 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4c06f6d4-b611-4030-92c9-8bea8f806635 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:53.890961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4c06f6d4-b611-4030-92c9-8bea8f806635 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1556 microversion: 2.1 time: 0.153478 May 27 09:46:53.891553 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 415/822] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:53 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:54.145200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e3362181-d86b-4c2b-99fc-5315e33bbeb9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:54.145809 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e3362181-d86b-4c2b-99fc-5315e33bbeb9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:54.147638 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=6 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:54.153594 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e3362181-d86b-4c2b-99fc-5315e33bbeb9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:54.154042 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e3362181-d86b-4c2b-99fc-5315e33bbeb9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:54.154815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e3362181-d86b-4c2b-99fc-5315e33bbeb9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:54.155258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e3362181-d86b-4c2b-99fc-5315e33bbeb9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:54.286827 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e3362181-d86b-4c2b-99fc-5315e33bbeb9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:54.294615 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e3362181-d86b-4c2b-99fc-5315e33bbeb9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:54.296156 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e3362181-d86b-4c2b-99fc-5315e33bbeb9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:54.297262 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e3362181-d86b-4c2b-99fc-5315e33bbeb9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1406 microversion: 2.20 time: 0.156104 May 27 09:46:54.297815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 408/823] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:54 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:54.909006 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bfcf3d68-29e0-40ac-9986-3901dc71030a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:54.909546 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bfcf3d68-29e0-40ac-9986-3901dc71030a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:54.916048 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bfcf3d68-29e0-40ac-9986-3901dc71030a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:54.916500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bfcf3d68-29e0-40ac-9986-3901dc71030a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:54.917266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bfcf3d68-29e0-40ac-9986-3901dc71030a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:54.917707 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bfcf3d68-29e0-40ac-9986-3901dc71030a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:55.046885 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bfcf3d68-29e0-40ac-9986-3901dc71030a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:55.054491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bfcf3d68-29e0-40ac-9986-3901dc71030a tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1556 microversion: 2.1 time: 0.149946 May 27 09:46:55.055059 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 416/824] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:54 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:55.316540 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6dbd94bb-081b-4b98-9408-f22d32cd1ca2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:55.317179 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6dbd94bb-081b-4b98-9408-f22d32cd1ca2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:55.323583 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dbd94bb-081b-4b98-9408-f22d32cd1ca2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:55.324025 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dbd94bb-081b-4b98-9408-f22d32cd1ca2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:55.324784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dbd94bb-081b-4b98-9408-f22d32cd1ca2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:55.325215 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dbd94bb-081b-4b98-9408-f22d32cd1ca2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:55.451915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6dbd94bb-081b-4b98-9408-f22d32cd1ca2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:55.464279 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6dbd94bb-081b-4b98-9408-f22d32cd1ca2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:55.466046 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6dbd94bb-081b-4b98-9408-f22d32cd1ca2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:55.467149 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6dbd94bb-081b-4b98-9408-f22d32cd1ca2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1406 microversion: 2.20 time: 0.155048 May 27 09:46:55.467754 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 409/825] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:55 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:56.071544 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0de1a598-802a-476d-89ad-76268a645a2d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:56.072161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0de1a598-802a-476d-89ad-76268a645a2d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:56.078648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0de1a598-802a-476d-89ad-76268a645a2d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:56.079098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0de1a598-802a-476d-89ad-76268a645a2d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:56.079980 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0de1a598-802a-476d-89ad-76268a645a2d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:56.080418 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0de1a598-802a-476d-89ad-76268a645a2d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:56.259085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0de1a598-802a-476d-89ad-76268a645a2d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:56.266531 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0de1a598-802a-476d-89ad-76268a645a2d tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1556 microversion: 2.1 time: 0.198886 May 27 09:46:56.267710 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 417/826] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:56 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1556 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:56.484274 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-23d364b1-66b9-4ff8-861c-5b202ec834df tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:56.484802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-23d364b1-66b9-4ff8-861c-5b202ec834df tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:56.491307 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-23d364b1-66b9-4ff8-861c-5b202ec834df tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:56.491766 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-23d364b1-66b9-4ff8-861c-5b202ec834df tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:56.492533 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-23d364b1-66b9-4ff8-861c-5b202ec834df tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:56.492972 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-23d364b1-66b9-4ff8-861c-5b202ec834df tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:56.706283 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-23d364b1-66b9-4ff8-861c-5b202ec834df tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:56.715502 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-23d364b1-66b9-4ff8-861c-5b202ec834df tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:56.717145 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-23d364b1-66b9-4ff8-861c-5b202ec834df tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:56.718343 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-23d364b1-66b9-4ff8-861c-5b202ec834df tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1406 microversion: 2.20 time: 0.238073 May 27 09:46:56.718906 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 410/827] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:56 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:57.012284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-57991762-3a5b-4b5f-88a0-866ec43bbc7e req-974297c5-6338-4580-959d-07c9051e13af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd942627-ce67-4a65-95dc-a589397bd130", "name": "network-vif-deleted", "tag": "7adfbb2e-f976-47e6-8ad5-c96c45292acc"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:57.021980 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-57991762-3a5b-4b5f-88a0-866ec43bbc7e req-974297c5-6338-4580-959d-07c9051e13af service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:57.022635 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-57991762-3a5b-4b5f-88a0-866ec43bbc7e req-974297c5-6338-4580-959d-07c9051e13af service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:57.034485 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-57991762-3a5b-4b5f-88a0-866ec43bbc7e req-974297c5-6338-4580-959d-07c9051e13af service nova] Creating event network-vif-deleted:7adfbb2e-f976-47e6-8ad5-c96c45292acc for instance cd942627-ce67-4a65-95dc-a589397bd130 on hv-cinder-79760 May 27 09:46:57.039483 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-57991762-3a5b-4b5f-88a0-866ec43bbc7e req-974297c5-6338-4580-959d-07c9051e13af service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030903 May 27 09:46:57.040072 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 418/828] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:57.285622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d614909b-c8e0-45aa-b9f7-03c1bc35a5b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:57.286235 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d614909b-c8e0-45aa-b9f7-03c1bc35a5b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:57.292333 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d614909b-c8e0-45aa-b9f7-03c1bc35a5b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:57.292776 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d614909b-c8e0-45aa-b9f7-03c1bc35a5b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:57.293535 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d614909b-c8e0-45aa-b9f7-03c1bc35a5b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:57.293968 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d614909b-c8e0-45aa-b9f7-03c1bc35a5b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:57.360600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d614909b-c8e0-45aa-b9f7-03c1bc35a5b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68b32d9217954d72a2b7aa3ba893f942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '050fc8655bd34646b1b3f211b6fd912a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:57.369069 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d614909b-c8e0-45aa-b9f7-03c1bc35a5b5 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 200 len: 1344 microversion: 2.1 time: 0.088868 May 27 09:46:57.369655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 411/829] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:57 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 1344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:57.738461 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-07073a21-4586-4edf-a195-75b128891c52 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:57.739117 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-07073a21-4586-4edf-a195-75b128891c52 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:57.745742 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07073a21-4586-4edf-a195-75b128891c52 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:57.746196 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07073a21-4586-4edf-a195-75b128891c52 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:57.746967 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07073a21-4586-4edf-a195-75b128891c52 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:57.747430 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-07073a21-4586-4edf-a195-75b128891c52 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:57.876758 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-07073a21-4586-4edf-a195-75b128891c52 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:57.884697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-07073a21-4586-4edf-a195-75b128891c52 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:57.886188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-07073a21-4586-4edf-a195-75b128891c52 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:57.887361 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-07073a21-4586-4edf-a195-75b128891c52 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1597 microversion: 2.20 time: 0.154450 May 27 09:46:57.887912 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 419/830] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:46:57 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1597 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:57.904830 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5dcaa8e7-c7e8-4c1f-b549-789b4b362927 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:57.905356 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5dcaa8e7-c7e8-4c1f-b549-789b4b362927 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:57.911773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dcaa8e7-c7e8-4c1f-b549-789b4b362927 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:57.912221 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dcaa8e7-c7e8-4c1f-b549-789b4b362927 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:57.912979 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dcaa8e7-c7e8-4c1f-b549-789b4b362927 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:57.913408 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5dcaa8e7-c7e8-4c1f-b549-789b4b362927 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:57.995590 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5dcaa8e7-c7e8-4c1f-b549-789b4b362927 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094500 May 27 09:46:57.996194 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 412/831] 10.222.0.41 () {60 vars in 1315 bytes} [Fri May 27 09:46:57 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:46:58.385908 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-904bc9e2-3e80-4570-aa94-0ca5be4b4041 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:58.386512 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-904bc9e2-3e80-4570-aa94-0ca5be4b4041 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] [instance: cd942627-ce67-4a65-95dc-a589397bd130] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:58.393217 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-904bc9e2-3e80-4570-aa94-0ca5be4b4041 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:58.393658 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-904bc9e2-3e80-4570-aa94-0ca5be4b4041 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:58.394413 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-904bc9e2-3e80-4570-aa94-0ca5be4b4041 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:58.394843 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-904bc9e2-3e80-4570-aa94-0ca5be4b4041 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:58.408913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-904bc9e2-3e80-4570-aa94-0ca5be4b4041 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] HTTP exception thrown: Instance cd942627-ce67-4a65-95dc-a589397bd130 could not be found. May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-904bc9e2-3e80-4570-aa94-0ca5be4b4041 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Request method failure captured: May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 HTTP/1.1 May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJydidDeRFOa5o5fj4jIcdPpHbImrUVcA5ZQzXbkxf8BfDIdDtSVUqgsIm8PKPj5qNU7lYJk9SUXc2CeQawc61s49KNDARJZaW2vAuHStqMUPGyF-QYSo6s8Cpxb8LZhjms6fPV8ltOelx-HOuQ54kEWagvq8W_FVHI7vmRNrCt0MA0 May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 050fc8655bd34646b1b3f211b6fd912a May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-TestMinimumBasicScenario-288821078 May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:46:58.410586 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/050fc8655bd34646b1b3f211b6fd912a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/050fc8655bd34646b1b3f211b6fd912a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/050fc8655bd34646b1b3f211b6fd912a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_050fc8655bd34646b1b3f211b6fd912a"}]}] May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-TestMinimumBasicScenario-288821078 May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 050fc8655bd34646b1b3f211b6fd912a May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-TestMinimumBasicScenario-288821078 May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-TestMinimumBasicScenario-288821078-project May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 68b32d9217954d72a2b7aa3ba893f942 May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-TestMinimumBasicScenario-288821078-project May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance cd942627-ce67-4a65-95dc-a589397bd130 could not be found. May 27 09:46:58.412195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': 'cd942627-ce67-4a65-95dc-a589397bd130'} May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd942627-ce67-4a65-95dc-a589397bd130 could not be found. May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:46:58.413037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd942627-ce67-4a65-95dc-a589397bd130 could not be found. May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd942627-ce67-4a65-95dc-a589397bd130 could not be found. May 27 09:46:58.414412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:46:58.415794 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-904bc9e2-3e80-4570-aa94-0ca5be4b4041 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Returning 404 to user: Instance cd942627-ce67-4a65-95dc-a589397bd130 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:46:58.415794 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-904bc9e2-3e80-4570-aa94-0ca5be4b4041 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130" status: 404 len: 111 microversion: 2.1 time: 0.029963 May 27 09:46:58.415794 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 420/832] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:46:58 2022] GET /compute/v2.1/servers/cd942627-ce67-4a65-95dc-a589397bd130 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:46:58.420700 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-505710b7-a69d-4883-a4d7-8cc39727c2e7 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] Calling method '.version_select at 0x7f188c32f040>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:58.439317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-505710b7-a69d-4883-a4d7-8cc39727c2e7 tempest-TestMinimumBasicScenario-288821078 tempest-TestMinimumBasicScenario-288821078-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1036635867" status: 202 len: 0 microversion: 2.1 time: 0.022286 May 27 09:46:58.440152 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 413/833] 10.222.0.41 () {58 vars in 1271 bytes} [Fri May 27 09:46:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1036635867 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:46:59.053828 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-884e0cfa-a5ed-4ef8-9f5b-c2661472219c req-11867a88-ab1d-4e18-bf56-6e7a8424fcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330ed71b-ab48-42b7-b46e-98be00f7343e", "tag": "9011439f-1b54-4948-87ab-dd7cd4f186e5"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:59.070977 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-884e0cfa-a5ed-4ef8-9f5b-c2661472219c req-11867a88-ab1d-4e18-bf56-6e7a8424fcb0 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:59.071450 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-884e0cfa-a5ed-4ef8-9f5b-c2661472219c req-11867a88-ab1d-4e18-bf56-6e7a8424fcb0 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:59.083530 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-884e0cfa-a5ed-4ef8-9f5b-c2661472219c req-11867a88-ab1d-4e18-bf56-6e7a8424fcb0 service nova] Creating event network-changed:9011439f-1b54-4948-87ab-dd7cd4f186e5 for instance 330ed71b-ab48-42b7-b46e-98be00f7343e on hv-cinder-79760 May 27 09:46:59.088940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-884e0cfa-a5ed-4ef8-9f5b-c2661472219c req-11867a88-ab1d-4e18-bf56-6e7a8424fcb0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038718 May 27 09:46:59.089889 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 421/834] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:27.983383 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=30 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:27.984127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:27.989017 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1514ba44-ecfd-4784-b94a-50b39f7d147a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:27.989541 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1514ba44-ecfd-4784-b94a-50b39f7d147a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:27.996561 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1514ba44-ecfd-4784-b94a-50b39f7d147a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:27.997005 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1514ba44-ecfd-4784-b94a-50b39f7d147a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:27.997760 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1514ba44-ecfd-4784-b94a-50b39f7d147a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:27.998193 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1514ba44-ecfd-4784-b94a-50b39f7d147a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.079124 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-1514ba44-ecfd-4784-b94a-50b39f7d147a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lazy-loading 'services' on Instance uuid 4572f19b-c60d-461e-8eec-9c9f8a25201c {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:47:28.147656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1514ba44-ecfd-4784-b94a-50b39f7d147a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments/d4b4a529-6aab-4a1b-9b7f-01ea747b3bb2" status: 202 len: 0 microversion: 2.1 time: 0.165582 May 27 09:47:28.148242 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 414/835] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:47:27 2022] DELETE /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments/d4b4a529-6aab-4a1b-9b7f-01ea747b3bb2 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:47:28.154553 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:28.155738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=26 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:28.160424 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-efa9d0f6-42ce-49bf-a291-4d737589fa60 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:28.161434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-efa9d0f6-42ce-49bf-a291-4d737589fa60 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:28.168900 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-efa9d0f6-42ce-49bf-a291-4d737589fa60 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:28.169436 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-efa9d0f6-42ce-49bf-a291-4d737589fa60 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.170215 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-efa9d0f6-42ce-49bf-a291-4d737589fa60 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:28.170654 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-efa9d0f6-42ce-49bf-a291-4d737589fa60 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.201788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-efa9d0f6-42ce-49bf-a291-4d737589fa60 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048870 May 27 09:47:28.202263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 422/836] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:47:28 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:28.520565 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-18039d28-affa-4528-bd9a-f584981018a4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:28.521638 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-18039d28-affa-4528-bd9a-f584981018a4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:28.527890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-18039d28-affa-4528-bd9a-f584981018a4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:28.528347 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-18039d28-affa-4528-bd9a-f584981018a4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.529117 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-18039d28-affa-4528-bd9a-f584981018a4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:28.529559 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-18039d28-affa-4528-bd9a-f584981018a4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.557372 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-18039d28-affa-4528-bd9a-f584981018a4 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041633 May 27 09:47:28.557916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 415/837] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:47:28 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:47:28.616119 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f4f1763f-e1bc-4d15-94b3-a939ed25b69f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:28.616611 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f4f1763f-e1bc-4d15-94b3-a939ed25b69f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:28.622454 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f4f1763f-e1bc-4d15-94b3-a939ed25b69f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:28.622899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f4f1763f-e1bc-4d15-94b3-a939ed25b69f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.623682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f4f1763f-e1bc-4d15-94b3-a939ed25b69f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:28.624112 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f4f1763f-e1bc-4d15-94b3-a939ed25b69f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.648078 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f4f1763f-e1bc-4d15-94b3-a939ed25b69f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Going to try to terminate instance {{(pid=129290) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:47:28.721830 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f4f1763f-e1bc-4d15-94b3-a939ed25b69f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 204 len: 0 microversion: 2.1 time: 0.108703 May 27 09:47:28.722319 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 423/838] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:47:28 2022] DELETE /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:47:28.730795 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9f710a7e-69c4-4a50-8a60-777a4ca96da8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:28.731491 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9f710a7e-69c4-4a50-8a60-777a4ca96da8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:28.737737 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9f710a7e-69c4-4a50-8a60-777a4ca96da8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:28.738191 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9f710a7e-69c4-4a50-8a60-777a4ca96da8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.738964 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9f710a7e-69c4-4a50-8a60-777a4ca96da8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:28.739464 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9f710a7e-69c4-4a50-8a60-777a4ca96da8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.873633 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9f710a7e-69c4-4a50-8a60-777a4ca96da8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:28.881992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9f710a7e-69c4-4a50-8a60-777a4ca96da8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1673 microversion: 2.1 time: 0.155234 May 27 09:47:28.882560 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 416/839] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:28 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:29.215335 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f47aacf9-cdc7-4eb3-812b-957b7384728a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:29.216356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f47aacf9-cdc7-4eb3-812b-957b7384728a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:29.222739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f47aacf9-cdc7-4eb3-812b-957b7384728a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:29.223191 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f47aacf9-cdc7-4eb3-812b-957b7384728a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:29.223988 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f47aacf9-cdc7-4eb3-812b-957b7384728a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:29.224429 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f47aacf9-cdc7-4eb3-812b-957b7384728a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:29.255047 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f47aacf9-cdc7-4eb3-812b-957b7384728a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 May 27 09:47:29.255616 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 424/840] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:47:29 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:29.899752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3e122b62-1a8f-4c3c-b010-4315ebaf5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:29.900367 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-3e122b62-1a8f-4c3c-b010-4315ebaf5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:29.906699 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3e122b62-1a8f-4c3c-b010-4315ebaf5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:29.907136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3e122b62-1a8f-4c3c-b010-4315ebaf5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:29.907933 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3e122b62-1a8f-4c3c-b010-4315ebaf5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:29.908886 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3e122b62-1a8f-4c3c-b010-4315ebaf5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:30.036891 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-3e122b62-1a8f-4c3c-b010-4315ebaf5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:30.044440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3e122b62-1a8f-4c3c-b010-4315ebaf5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1673 microversion: 2.1 time: 0.148528 May 27 09:47:30.045021 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 417/841] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:29 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:30.266013 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7103dd47-6f6f-44d0-bc70-6c38cd8869fa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:30.266964 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7103dd47-6f6f-44d0-bc70-6c38cd8869fa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:30.274086 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7103dd47-6f6f-44d0-bc70-6c38cd8869fa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:30.274537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7103dd47-6f6f-44d0-bc70-6c38cd8869fa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:30.275393 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7103dd47-6f6f-44d0-bc70-6c38cd8869fa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:30.275811 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7103dd47-6f6f-44d0-bc70-6c38cd8869fa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:30.304577 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7103dd47-6f6f-44d0-bc70-6c38cd8869fa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042415 May 27 09:47:30.305130 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 425/842] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:47:30 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:47:30.382814 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-bea1a999-9db4-496a-b008-f7261686c50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:30.383342 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bea1a999-9db4-496a-b008-f7261686c50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:30.389334 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bea1a999-9db4-496a-b008-f7261686c50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:30.389786 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bea1a999-9db4-496a-b008-f7261686c50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:30.390557 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bea1a999-9db4-496a-b008-f7261686c50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:30.391000 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bea1a999-9db4-496a-b008-f7261686c50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:30.416639 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bea1a999-9db4-496a-b008-f7261686c50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:47:30.503814 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-bea1a999-9db4-496a-b008-f7261686c50e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 204 len: 0 microversion: 2.1 time: 0.124425 May 27 09:47:30.504861 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 418/843] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:47:30 2022] DELETE /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:47:30.512322 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e0eb71d6-ecd4-43e4-8434-0d62d0419c84 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:30.512940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e0eb71d6-ecd4-43e4-8434-0d62d0419c84 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:30.519381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e0eb71d6-ecd4-43e4-8434-0d62d0419c84 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:30.519837 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e0eb71d6-ecd4-43e4-8434-0d62d0419c84 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:30.520604 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e0eb71d6-ecd4-43e4-8434-0d62d0419c84 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:30.521041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e0eb71d6-ecd4-43e4-8434-0d62d0419c84 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:30.740357 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e0eb71d6-ecd4-43e4-8434-0d62d0419c84 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:30.747911 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e0eb71d6-ecd4-43e4-8434-0d62d0419c84 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1688 microversion: 2.1 time: 0.239410 May 27 09:47:30.748480 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 426/844] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:30 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1688 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:31.067355 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-21cc7a91-8510-474a-843a-73fc57f39a25 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:31.068067 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-21cc7a91-8510-474a-843a-73fc57f39a25 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:31.074739 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-21cc7a91-8510-474a-843a-73fc57f39a25 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:31.075128 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-21cc7a91-8510-474a-843a-73fc57f39a25 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:31.076142 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-21cc7a91-8510-474a-843a-73fc57f39a25 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:31.076586 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-21cc7a91-8510-474a-843a-73fc57f39a25 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:31.154411 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-21cc7a91-8510-474a-843a-73fc57f39a25 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:31.154619 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-bc83a025-bb82-4631-9e2f-862de7efc190 req-f4997f0a-77dd-41ea-b9b0-39e28e44749c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c817de-8115-43f6-9a05-6366318ea29f", "name": "network-vif-deleted", "tag": "170fc0f5-d663-45e7-aca9-b414a735e887"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:31.162940 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-bc83a025-bb82-4631-9e2f-862de7efc190 req-f4997f0a-77dd-41ea-b9b0-39e28e44749c service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:31.163240 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-21cc7a91-8510-474a-843a-73fc57f39a25 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1605 microversion: 2.1 time: 0.105072 May 27 09:47:31.163413 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-bc83a025-bb82-4631-9e2f-862de7efc190 req-f4997f0a-77dd-41ea-b9b0-39e28e44749c service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:31.164221 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 419/845] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:31 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1605 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:31.175374 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-bc83a025-bb82-4631-9e2f-862de7efc190 req-f4997f0a-77dd-41ea-b9b0-39e28e44749c service nova] Creating event network-vif-deleted:170fc0f5-d663-45e7-aca9-b414a735e887 for instance d5c817de-8115-43f6-9a05-6366318ea29f on hv-cinder-79760 May 27 09:47:31.180587 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-bc83a025-bb82-4631-9e2f-862de7efc190 req-f4997f0a-77dd-41ea-b9b0-39e28e44749c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030159 May 27 09:47:31.181385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 427/846] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:47:31.764806 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9a31eb0d-ac1f-4aeb-b059-e4ea2f8ad501 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:31.765413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9a31eb0d-ac1f-4aeb-b059-e4ea2f8ad501 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:31.772053 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9a31eb0d-ac1f-4aeb-b059-e4ea2f8ad501 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:31.772496 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9a31eb0d-ac1f-4aeb-b059-e4ea2f8ad501 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:31.773259 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9a31eb0d-ac1f-4aeb-b059-e4ea2f8ad501 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:31.773689 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9a31eb0d-ac1f-4aeb-b059-e4ea2f8ad501 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:31.907117 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9a31eb0d-ac1f-4aeb-b059-e4ea2f8ad501 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:31.914867 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9a31eb0d-ac1f-4aeb-b059-e4ea2f8ad501 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1688 microversion: 2.1 time: 0.153888 May 27 09:47:31.915466 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 420/847] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:31 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:32.180823 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6b64cc94-91e2-4ac3-8fb2-0270b956e638 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:32.181531 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6b64cc94-91e2-4ac3-8fb2-0270b956e638 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:32.188276 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6b64cc94-91e2-4ac3-8fb2-0270b956e638 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:32.188735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6b64cc94-91e2-4ac3-8fb2-0270b956e638 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:32.190029 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6b64cc94-91e2-4ac3-8fb2-0270b956e638 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:32.190473 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6b64cc94-91e2-4ac3-8fb2-0270b956e638 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:32.251439 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6b64cc94-91e2-4ac3-8fb2-0270b956e638 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:32.259482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6b64cc94-91e2-4ac3-8fb2-0270b956e638 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1605 microversion: 2.1 time: 0.083040 May 27 09:47:32.260042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 428/848] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:32 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1605 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:32.932758 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-35749bf5-e1bc-4550-aabd-2ab5e2beeec0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:32.933370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-35749bf5-e1bc-4550-aabd-2ab5e2beeec0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:32.939920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35749bf5-e1bc-4550-aabd-2ab5e2beeec0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:32.940373 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35749bf5-e1bc-4550-aabd-2ab5e2beeec0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:32.941137 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35749bf5-e1bc-4550-aabd-2ab5e2beeec0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:32.941575 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-35749bf5-e1bc-4550-aabd-2ab5e2beeec0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:33.069631 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-35749bf5-e1bc-4550-aabd-2ab5e2beeec0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:33.077039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-35749bf5-e1bc-4550-aabd-2ab5e2beeec0 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1688 microversion: 2.1 time: 0.148149 May 27 09:47:33.077600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 421/849] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:32 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:33.276763 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b1c93e97-8703-4a0f-bdd1-46c7eeff2f07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:33.277370 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b1c93e97-8703-4a0f-bdd1-46c7eeff2f07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:33.284422 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b1c93e97-8703-4a0f-bdd1-46c7eeff2f07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:33.284865 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b1c93e97-8703-4a0f-bdd1-46c7eeff2f07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:33.285619 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b1c93e97-8703-4a0f-bdd1-46c7eeff2f07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:33.286050 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b1c93e97-8703-4a0f-bdd1-46c7eeff2f07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:33.347244 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b1c93e97-8703-4a0f-bdd1-46c7eeff2f07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:33.354571 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b1c93e97-8703-4a0f-bdd1-46c7eeff2f07 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1605 microversion: 2.1 time: 0.081686 May 27 09:47:33.355126 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 429/850] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:33 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1605 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:34.094034 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-19798234-ed6c-4f9b-a6f3-382d93afab49 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:34.094643 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-19798234-ed6c-4f9b-a6f3-382d93afab49 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:34.101666 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-19798234-ed6c-4f9b-a6f3-382d93afab49 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:34.102118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-19798234-ed6c-4f9b-a6f3-382d93afab49 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:34.102884 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-19798234-ed6c-4f9b-a6f3-382d93afab49 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:34.103341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-19798234-ed6c-4f9b-a6f3-382d93afab49 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:34.310558 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-19798234-ed6c-4f9b-a6f3-382d93afab49 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:34.318027 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-19798234-ed6c-4f9b-a6f3-382d93afab49 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1688 microversion: 2.1 time: 0.227780 May 27 09:47:34.318539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 422/851] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:34 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1688 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:34.371508 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:34.372693 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:34.378479 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:34.378926 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:34.379721 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:34.380170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:34.410880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:34.411343 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:34.411790 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lazy-loading 'fault' on Instance uuid d5c817de-8115-43f6-9a05-6366318ea29f {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:47:34.491554 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:34.501984 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-68b7ba55-2d49-4c8d-aba2-c21b493de36c tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 200 len: 1326 microversion: 2.1 time: 0.134278 May 27 09:47:34.509207 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 430/852] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:34 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 1326 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:35.242924 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-0c6ebc75-fde5-44d4-a2f6-a5558f447ed0 req-bf0ea902-2da3-4c8b-9801-c04e89fe3577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4572f19b-c60d-461e-8eec-9c9f8a25201c", "name": "network-vif-deleted", "tag": "be291203-ca93-4891-adc1-934c52d11bd3"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:35.252079 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-0c6ebc75-fde5-44d4-a2f6-a5558f447ed0 req-bf0ea902-2da3-4c8b-9801-c04e89fe3577 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:35.252534 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-0c6ebc75-fde5-44d4-a2f6-a5558f447ed0 req-bf0ea902-2da3-4c8b-9801-c04e89fe3577 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:35.263999 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-0c6ebc75-fde5-44d4-a2f6-a5558f447ed0 req-bf0ea902-2da3-4c8b-9801-c04e89fe3577 service nova] Creating event network-vif-deleted:be291203-ca93-4891-adc1-934c52d11bd3 for instance 4572f19b-c60d-461e-8eec-9c9f8a25201c on hv-cinder-79760 May 27 09:47:35.271145 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-0c6ebc75-fde5-44d4-a2f6-a5558f447ed0 req-bf0ea902-2da3-4c8b-9801-c04e89fe3577 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031709 May 27 09:47:35.272278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 423/853] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:35.334691 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:35.335320 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:35.342636 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:35.343476 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:35.344329 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:35.344778 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:35.379047 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:35.379787 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:35.380052 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lazy-loading 'fault' on Instance uuid 4572f19b-c60d-461e-8eec-9c9f8a25201c {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:47:35.423764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:35.431136 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fcd3449a-d24c-4dc7-906c-41d1a2c2b56e tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 200 len: 1335 microversion: 2.1 time: 0.101000 May 27 09:47:35.431727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 431/854] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:35 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:35.520550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-026191bd-1d84-43c5-91fe-b49e1c942e4b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:35.521326 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-026191bd-1d84-43c5-91fe-b49e1c942e4b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:35.527547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-026191bd-1d84-43c5-91fe-b49e1c942e4b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:35.528027 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-026191bd-1d84-43c5-91fe-b49e1c942e4b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:35.528796 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-026191bd-1d84-43c5-91fe-b49e1c942e4b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:35.529227 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-026191bd-1d84-43c5-91fe-b49e1c942e4b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:35.542931 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-026191bd-1d84-43c5-91fe-b49e1c942e4b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] HTTP exception thrown: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-026191bd-1d84-43c5-91fe-b49e1c942e4b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Request method failure captured: May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f HTTP/1.1 May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJw9oOm2RiM8wUbsXVgubOOLdR_nWsLqhV_M3N5RHT0uVzprERX4dGeAoJkjRdRsnlntvTXqNp-zRysr9sefmnmpC68GOuDR4uRL5JXsL4vW_6Ggreon_S3ASGx7Dft7e7OOpNlBezyMnnUYPq00ExsB2lqn2wDVWKoTeldY0v2zkOw May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:47:35.544547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_06332dc6f29b4d01b047104d93bbef0f"}]}] May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeTestJSON-1260786785 May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 2463c2327e364ca996768e3eb6ef6316 May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:47:35.545932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'd5c817de-8115-43f6-9a05-6366318ea29f'} May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:47:35.546709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:47:35.547998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:35.550140 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-026191bd-1d84-43c5-91fe-b49e1c942e4b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Returning 404 to user: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:47:35.550140 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-026191bd-1d84-43c5-91fe-b49e1c942e4b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 404 len: 111 microversion: 2.1 time: 0.030468 May 27 09:47:35.550140 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 424/855] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:35 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:47:35.554728 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b1870d33-2566-46ad-9109-b8fad920c335 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '.version_select at 0x7f188c297b80>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:35.571540 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b1870d33-2566-46ad-9109-b8fad920c335 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-324865065" status: 202 len: 0 microversion: 2.1 time: 0.020500 May 27 09:47:35.572095 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 432/856] 10.222.0.41 () {58 vars in 1217 bytes} [Fri May 27 09:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-324865065 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:47:36.226277 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6b6d97b1-01ff-454e-8808-616b17eed786 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'create', calling method: .version_select at 0x7f188c32f700>, body: {"keypair": {"name": "tempest-keypair-757181806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWvGXRxyi3iXCBCu4JmoqNReNscH3DRNl3bxgUT8DKgWlQitdV6PMMP0iCk9DZ4QydguHUgD2LbS8gJm7WzCTTZRmGJuyP5X0tLDtnmNq9JLbkzA2MFRqeQ0YGjPoVm4g=="}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:36.241444 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-6b6d97b1-01ff-454e-8808-616b17eed786 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Getting quotas for project 06332dc6f29b4d01b047104d93bbef0f. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:47:36.245448 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-6b6d97b1-01ff-454e-8808-616b17eed786 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Getting quotas for user 2463c2327e364ca996768e3eb6ef6316 and project 06332dc6f29b4d01b047104d93bbef0f. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:47:36.271577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6b6d97b1-01ff-454e-8808-616b17eed786 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054144 May 27 09:47:36.272180 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 425/857] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 09:47:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:36.452235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-10e72121-b5c5-4e2b-8486-c39a7a9505f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:36.452858 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-10e72121-b5c5-4e2b-8486-c39a7a9505f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 4572f19b-c60d-461e-8eec-9c9f8a25201c] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:36.461136 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-10e72121-b5c5-4e2b-8486-c39a7a9505f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:36.461733 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-10e72121-b5c5-4e2b-8486-c39a7a9505f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:36.462555 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-10e72121-b5c5-4e2b-8486-c39a7a9505f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:36.462997 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-10e72121-b5c5-4e2b-8486-c39a7a9505f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:36.479458 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-10e72121-b5c5-4e2b-8486-c39a7a9505f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] HTTP exception thrown: Instance 4572f19b-c60d-461e-8eec-9c9f8a25201c could not be found. May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-10e72121-b5c5-4e2b-8486-c39a7a9505f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Request method failure captured: May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c HTTP/1.1 May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJw8E69kc370trEXLpeY6UITestdwiquS5mhSQcfPgVOJi0R1BN1wUgAoLk7mJ_L26eDt4wZYQTLjuroG7w77s0HjSvRGsjWg8o4I5dW0q4LWmFIv0U1ANsH9YdQbasIIX2q8iO712z46SNFk9oHoWfSqkGNcR1-QodSA-SM0eE8kFI May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 0cad683f27d14cf5a90a19525a467a52 May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:47:36.481093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0cad683f27d14cf5a90a19525a467a52"}]}] May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 0cad683f27d14cf5a90a19525a467a52 May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-ServerRescueNegativeTestJSON-221303946-project May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 1331ba69eaec44dd9bd8f8db7d53ba5c May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-ServerRescueNegativeTestJSON-221303946-project May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 4572f19b-c60d-461e-8eec-9c9f8a25201c could not be found. May 27 09:47:36.482683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '4572f19b-c60d-461e-8eec-9c9f8a25201c'} May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4572f19b-c60d-461e-8eec-9c9f8a25201c could not be found. May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:47:36.483642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4572f19b-c60d-461e-8eec-9c9f8a25201c could not be found. May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4572f19b-c60d-461e-8eec-9c9f8a25201c could not be found. May 27 09:47:36.485230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:47:36.487030 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-10e72121-b5c5-4e2b-8486-c39a7a9505f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Returning 404 to user: Instance 4572f19b-c60d-461e-8eec-9c9f8a25201c could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:47:36.487030 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-10e72121-b5c5-4e2b-8486-c39a7a9505f8 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c" status: 404 len: 111 microversion: 2.1 time: 0.038704 May 27 09:47:36.487030 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 433/858] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:36 2022] GET /compute/v2.1/servers/4572f19b-c60d-461e-8eec-9c9f8a25201c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:47:36.492118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1e28607b-5a0c-4ca2-97ec-1b24e205ccbd tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '.version_select at 0x7f188c3a4f70>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:36.512509 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1e28607b-5a0c-4ca2-97ec-1b24e205ccbd tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532097097" status: 202 len: 0 microversion: 2.1 time: 0.024238 May 27 09:47:36.513243 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 426/859] 10.222.0.41 () {58 vars in 1220 bytes} [Fri May 27 09:47:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532097097 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:47:38.019534 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-494202790", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7de8cf2a-342a-4bc6-91a1-b3ed2cf7f88d"}], "security_groups": [{"name": "tempest-securitygroup--693738343"}], "key_name": "tempest-keypair-757181806", "user_data": "}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:38.119669 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] validate_networks() for [('7de8cf2a-342a-4bc6-91a1-b3ed2cf7f88d', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:47:38.480263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:47:38.480688 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:47:38.481168 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:47:38.481575 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:47:38.481988 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:47:38.490667 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:38.491123 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:38.491962 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:38.492404 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:38.508807 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Getting quotas for project 06332dc6f29b4d01b047104d93bbef0f. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:47:38.512934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Getting quotas for user 2463c2327e364ca996768e3eb6ef6316 and project 06332dc6f29b4d01b047104d93bbef0f. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:47:38.525731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:47:38.528044 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:47:38.576115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-416713ac-c440-4d0f-8387-6716d58e04b1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.560822 May 27 09:47:38.576886 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 434/860] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:47:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:47:38.587770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-65f763bf-7b31-4f8f-a8fc-90d1cd091d3e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:38.588379 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-65f763bf-7b31-4f8f-a8fc-90d1cd091d3e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:38.644883 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-65f763bf-7b31-4f8f-a8fc-90d1cd091d3e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:38.653831 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-65f763bf-7b31-4f8f-a8fc-90d1cd091d3e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1236 microversion: 2.1 time: 0.070156 May 27 09:47:38.663899 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 427/861] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:38 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:39.669880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6df03a4d-4900-4039-9ee0-a01cf2aa4928 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:39.671227 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6df03a4d-4900-4039-9ee0-a01cf2aa4928 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:39.678711 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6df03a4d-4900-4039-9ee0-a01cf2aa4928 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:39.679512 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6df03a4d-4900-4039-9ee0-a01cf2aa4928 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:39.680510 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6df03a4d-4900-4039-9ee0-a01cf2aa4928 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:39.681152 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6df03a4d-4900-4039-9ee0-a01cf2aa4928 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:39.766062 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6df03a4d-4900-4039-9ee0-a01cf2aa4928 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:39.774130 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6df03a4d-4900-4039-9ee0-a01cf2aa4928 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1306 microversion: 2.1 time: 0.108033 May 27 09:47:39.774695 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 435/862] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:39 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:39.791753 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b4b61c33-f1c9-4608-b590-c7368763c95a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:39.792954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b4b61c33-f1c9-4608-b590-c7368763c95a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:39.799641 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b4b61c33-f1c9-4608-b590-c7368763c95a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:39.800088 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b4b61c33-f1c9-4608-b590-c7368763c95a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:39.800860 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b4b61c33-f1c9-4608-b590-c7368763c95a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:39.801298 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b4b61c33-f1c9-4608-b590-c7368763c95a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:39.827730 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b4b61c33-f1c9-4608-b590-c7368763c95a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:47:39.902114 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b4b61c33-f1c9-4608-b590-c7368763c95a tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 204 len: 0 microversion: 2.1 time: 0.114342 May 27 09:47:39.903268 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 428/863] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:47:39 2022] DELETE /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:47:39.912476 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-dec69f8b-427a-446e-aebb-f2f941611323 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:39.913179 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-dec69f8b-427a-446e-aebb-f2f941611323 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:39.919243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dec69f8b-427a-446e-aebb-f2f941611323 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:39.919730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dec69f8b-427a-446e-aebb-f2f941611323 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:39.920556 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dec69f8b-427a-446e-aebb-f2f941611323 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:39.920937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-dec69f8b-427a-446e-aebb-f2f941611323 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:40.122363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-dec69f8b-427a-446e-aebb-f2f941611323 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:40.130348 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-dec69f8b-427a-446e-aebb-f2f941611323 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1507 microversion: 2.1 time: 0.222519 May 27 09:47:40.130919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 436/864] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:39 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:40.792857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4837d63b-f594-4971-82fc-4ef517ad7fb8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:40.793683 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4837d63b-f594-4971-82fc-4ef517ad7fb8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:40.800948 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4837d63b-f594-4971-82fc-4ef517ad7fb8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:40.801410 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4837d63b-f594-4971-82fc-4ef517ad7fb8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:40.802191 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4837d63b-f594-4971-82fc-4ef517ad7fb8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:40.802634 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4837d63b-f594-4971-82fc-4ef517ad7fb8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:41.147493 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0089263f-0fdf-4a94-8857-5cef7f3af065 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:41.148106 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0089263f-0fdf-4a94-8857-5cef7f3af065 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:41.154676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0089263f-0fdf-4a94-8857-5cef7f3af065 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:41.155133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0089263f-0fdf-4a94-8857-5cef7f3af065 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:41.155954 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0089263f-0fdf-4a94-8857-5cef7f3af065 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:41.156401 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0089263f-0fdf-4a94-8857-5cef7f3af065 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:41.200453 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4837d63b-f594-4971-82fc-4ef517ad7fb8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:41.208445 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4837d63b-f594-4971-82fc-4ef517ad7fb8 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1361 microversion: 2.1 time: 0.419898 May 27 09:47:41.209267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 429/865] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:40 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1361 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:41.431517 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0089263f-0fdf-4a94-8857-5cef7f3af065 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:41.439189 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0089263f-0fdf-4a94-8857-5cef7f3af065 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 200 len: 1507 microversion: 2.1 time: 0.295732 May 27 09:47:41.439799 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 437/866] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:41 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:47:41.821948 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-0b86c28d-6cfc-4cc0-9f50-b15fd50c3fac req-d6209a08-8393-4aba-8cde-25670d55b90c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2cecc3-140a-45b6-8b02-86784963dcf8", "name": "network-vif-deleted", "tag": "d50b1a7c-b3da-4b5c-bca2-2cc99a43949e"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:41.833334 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-0b86c28d-6cfc-4cc0-9f50-b15fd50c3fac req-d6209a08-8393-4aba-8cde-25670d55b90c service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:41.833970 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-0b86c28d-6cfc-4cc0-9f50-b15fd50c3fac req-d6209a08-8393-4aba-8cde-25670d55b90c service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:41.849346 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-0b86c28d-6cfc-4cc0-9f50-b15fd50c3fac req-d6209a08-8393-4aba-8cde-25670d55b90c service nova] Creating event network-vif-deleted:d50b1a7c-b3da-4b5c-bca2-2cc99a43949e for instance 7b2cecc3-140a-45b6-8b02-86784963dcf8 on hv-cinder-79760 May 27 09:47:41.857008 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-0b86c28d-6cfc-4cc0-9f50-b15fd50c3fac req-d6209a08-8393-4aba-8cde-25670d55b90c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038789 May 27 09:47:41.858071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 430/867] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:42.225287 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-952ed689-6905-4bc7-a5ec-fdcee7914fb7 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:42.225916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-952ed689-6905-4bc7-a5ec-fdcee7914fb7 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:42.232502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-952ed689-6905-4bc7-a5ec-fdcee7914fb7 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:42.232957 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-952ed689-6905-4bc7-a5ec-fdcee7914fb7 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:42.233876 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-952ed689-6905-4bc7-a5ec-fdcee7914fb7 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:42.234336 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-952ed689-6905-4bc7-a5ec-fdcee7914fb7 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:42.456914 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5087c5dd-33df-4db9-ba2d-d2436fdfe078 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:42.457618 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5087c5dd-33df-4db9-ba2d-d2436fdfe078 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: 7b2cecc3-140a-45b6-8b02-86784963dcf8] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:42.461442 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-952ed689-6905-4bc7-a5ec-fdcee7914fb7 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:42.464941 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5087c5dd-33df-4db9-ba2d-d2436fdfe078 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:42.465390 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5087c5dd-33df-4db9-ba2d-d2436fdfe078 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:42.466333 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5087c5dd-33df-4db9-ba2d-d2436fdfe078 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:42.466945 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5087c5dd-33df-4db9-ba2d-d2436fdfe078 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:42.469916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-952ed689-6905-4bc7-a5ec-fdcee7914fb7 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1361 microversion: 2.1 time: 0.248738 May 27 09:47:42.471034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 438/868] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:42 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:42.481247 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-5087c5dd-33df-4db9-ba2d-d2436fdfe078 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] HTTP exception thrown: Instance 7b2cecc3-140a-45b6-8b02-86784963dcf8 could not be found. May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5087c5dd-33df-4db9-ba2d-d2436fdfe078 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Request method failure captured: May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 HTTP/1.1 May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJw8E69kc370trEXLpeY6UITestdwiquS5mhSQcfPgVOJi0R1BN1wUgAoLk7mJ_L26eDt4wZYQTLjuroG7w77s0HjSvRGsjWg8o4I5dW0q4LWmFIv0U1ANsH9YdQbasIIX2q8iO712z46SNFk9oHoWfSqkGNcR1-QodSA-SM0eE8kFI May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 0cad683f27d14cf5a90a19525a467a52 May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:47:42.482890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0cad683f27d14cf5a90a19525a467a52"}]}] May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 0cad683f27d14cf5a90a19525a467a52 May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-ServerRescueNegativeTestJSON-221303946-project May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 1331ba69eaec44dd9bd8f8db7d53ba5c May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-ServerRescueNegativeTestJSON-221303946-project May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 7b2cecc3-140a-45b6-8b02-86784963dcf8 could not be found. May 27 09:47:42.484484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '7b2cecc3-140a-45b6-8b02-86784963dcf8'} May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2cecc3-140a-45b6-8b02-86784963dcf8 could not be found. May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:47:42.485300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2cecc3-140a-45b6-8b02-86784963dcf8 could not be found. May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2cecc3-140a-45b6-8b02-86784963dcf8 could not be found. May 27 09:47:42.487322 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:42.488634 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5087c5dd-33df-4db9-ba2d-d2436fdfe078 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Returning 404 to user: Instance 7b2cecc3-140a-45b6-8b02-86784963dcf8 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:47:42.488634 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5087c5dd-33df-4db9-ba2d-d2436fdfe078 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8" status: 404 len: 111 microversion: 2.1 time: 0.032049 May 27 09:47:42.488634 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 431/869] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:42 2022] GET /compute/v2.1/servers/7b2cecc3-140a-45b6-8b02-86784963dcf8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 09:47:42.494668 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-824d4cbe-2079-40dd-a392-39c0ca8243aa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:42.495170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-824d4cbe-2079-40dd-a392-39c0ca8243aa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:42.501394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-824d4cbe-2079-40dd-a392-39c0ca8243aa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:42.501984 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-824d4cbe-2079-40dd-a392-39c0ca8243aa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:42.502769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-824d4cbe-2079-40dd-a392-39c0ca8243aa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:42.503196 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-824d4cbe-2079-40dd-a392-39c0ca8243aa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:42.507878 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:42.530593 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-824d4cbe-2079-40dd-a392-39c0ca8243aa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Going to try to terminate instance {{(pid=129290) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:47:42.605939 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-824d4cbe-2079-40dd-a392-39c0ca8243aa tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "DELETE /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 204 len: 0 microversion: 2.1 time: 0.114536 May 27 09:47:42.606449 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 439/870] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:47:42 2022] DELETE /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:47:42.616628 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6dc37a98-b055-4565-9809-5155a56f9fe4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:42.617241 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6dc37a98-b055-4565-9809-5155a56f9fe4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:42.623549 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dc37a98-b055-4565-9809-5155a56f9fe4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:42.624074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dc37a98-b055-4565-9809-5155a56f9fe4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:42.624839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dc37a98-b055-4565-9809-5155a56f9fe4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:42.625276 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6dc37a98-b055-4565-9809-5155a56f9fe4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:42.629465 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:42.758553 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6dc37a98-b055-4565-9809-5155a56f9fe4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:42.765886 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6dc37a98-b055-4565-9809-5155a56f9fe4 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.155053 May 27 09:47:42.766455 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 432/871] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:42 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:43.488258 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-11bcc416-c480-40b0-a6c0-e0710556c94f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:43.489029 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-11bcc416-c480-40b0-a6c0-e0710556c94f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:43.495416 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11bcc416-c480-40b0-a6c0-e0710556c94f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:43.495872 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11bcc416-c480-40b0-a6c0-e0710556c94f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:43.496640 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11bcc416-c480-40b0-a6c0-e0710556c94f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:43.497081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-11bcc416-c480-40b0-a6c0-e0710556c94f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:43.628536 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-11bcc416-c480-40b0-a6c0-e0710556c94f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:43.635892 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-11bcc416-c480-40b0-a6c0-e0710556c94f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1361 microversion: 2.1 time: 0.152438 May 27 09:47:43.636456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 440/872] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:43 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:43.782977 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3797ef65-f4ac-437e-b272-0208b451b763 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:43.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-3797ef65-f4ac-437e-b272-0208b451b763 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:43.790258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3797ef65-f4ac-437e-b272-0208b451b763 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:43.790700 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3797ef65-f4ac-437e-b272-0208b451b763 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:43.791497 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3797ef65-f4ac-437e-b272-0208b451b763 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:43.791930 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3797ef65-f4ac-437e-b272-0208b451b763 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:43.873493 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-e9e57e0c-2def-44ce-be78-34602d50c320 req-4da311d3-9dc7-4b4e-994f-b3bcca117e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ce3d24-302e-4c81-ae42-b0670172d8d6", "tag": "dc3fff52-3e58-4032-878e-443fd16673dd"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:43.881522 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e9e57e0c-2def-44ce-be78-34602d50c320 req-4da311d3-9dc7-4b4e-994f-b3bcca117e82 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:43.881972 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e9e57e0c-2def-44ce-be78-34602d50c320 req-4da311d3-9dc7-4b4e-994f-b3bcca117e82 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:43.892760 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-e9e57e0c-2def-44ce-be78-34602d50c320 req-4da311d3-9dc7-4b4e-994f-b3bcca117e82 service nova] Creating event network-changed:dc3fff52-3e58-4032-878e-443fd16673dd for instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 on hv-cinder-79760 May 27 09:47:43.897551 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-e9e57e0c-2def-44ce-be78-34602d50c320 req-4da311d3-9dc7-4b4e-994f-b3bcca117e82 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027757 May 27 09:47:43.898145 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 441/873] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:47:43.929779 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-3797ef65-f4ac-437e-b272-0208b451b763 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:43.937326 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3797ef65-f4ac-437e-b272-0208b451b763 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.158174 May 27 09:47:43.937889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 433/874] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:43 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:44.653446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-954da54a-3c72-4045-a5ef-c6052c3b750b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:44.654143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-954da54a-3c72-4045-a5ef-c6052c3b750b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:44.660366 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-954da54a-3c72-4045-a5ef-c6052c3b750b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:44.660809 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-954da54a-3c72-4045-a5ef-c6052c3b750b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:44.661561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-954da54a-3c72-4045-a5ef-c6052c3b750b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:44.661992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-954da54a-3c72-4045-a5ef-c6052c3b750b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:44.793473 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-954da54a-3c72-4045-a5ef-c6052c3b750b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:44.801317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-954da54a-3c72-4045-a5ef-c6052c3b750b tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1361 microversion: 2.1 time: 0.152540 May 27 09:47:44.801883 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 442/875] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:44 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:44.953235 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-030cf316-7cad-4985-8903-4e58e93169e6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:44.953869 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-030cf316-7cad-4985-8903-4e58e93169e6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:44.961031 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-030cf316-7cad-4985-8903-4e58e93169e6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:44.961480 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-030cf316-7cad-4985-8903-4e58e93169e6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:44.962239 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-030cf316-7cad-4985-8903-4e58e93169e6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:44.962677 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-030cf316-7cad-4985-8903-4e58e93169e6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:45.091052 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-030cf316-7cad-4985-8903-4e58e93169e6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:45.099087 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-030cf316-7cad-4985-8903-4e58e93169e6 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.149720 May 27 09:47:45.099676 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 434/876] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:44 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:45.818577 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b99cd001-5332-4475-93d5-fc57ccd8d06a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:45.819191 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b99cd001-5332-4475-93d5-fc57ccd8d06a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:45.825776 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b99cd001-5332-4475-93d5-fc57ccd8d06a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:45.826238 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b99cd001-5332-4475-93d5-fc57ccd8d06a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:45.827013 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b99cd001-5332-4475-93d5-fc57ccd8d06a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:45.827484 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b99cd001-5332-4475-93d5-fc57ccd8d06a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:46.040138 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b99cd001-5332-4475-93d5-fc57ccd8d06a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:46.047644 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b99cd001-5332-4475-93d5-fc57ccd8d06a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1361 microversion: 2.1 time: 0.233486 May 27 09:47:46.048724 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 443/877] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:45 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:46.115759 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-467bf6a3-c4b6-41d4-98e1-33a6a625a3c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:46.116287 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-467bf6a3-c4b6-41d4-98e1-33a6a625a3c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:46.122913 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-467bf6a3-c4b6-41d4-98e1-33a6a625a3c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:46.123391 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-467bf6a3-c4b6-41d4-98e1-33a6a625a3c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:46.124158 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-467bf6a3-c4b6-41d4-98e1-33a6a625a3c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:46.124589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-467bf6a3-c4b6-41d4-98e1-33a6a625a3c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:46.670753 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-467bf6a3-c4b6-41d4-98e1-33a6a625a3c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1331ba69eaec44dd9bd8f8db7d53ba5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cad683f27d14cf5a90a19525a467a52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:46.678792 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-467bf6a3-c4b6-41d4-98e1-33a6a625a3c7 tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 200 len: 1522 microversion: 2.1 time: 0.566958 May 27 09:47:46.679391 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 435/878] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:46 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:47.080378 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-ed3e60e3-955b-42bc-8053-8ec1e5a567d9 req-b26f08e1-ff41-42da-8d36-1e55e1823ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf3a64e-1d00-4751-816f-74abd2af6e39", "name": "network-vif-deleted", "tag": "adc5b363-c80d-48e0-98dd-a4279791062f"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:47.081007 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e57a1fc4-0558-494c-ab77-77bebfba5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:47.081699 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e57a1fc4-0558-494c-ab77-77bebfba5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:47.098645 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e57a1fc4-0558-494c-ab77-77bebfba5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:47.099168 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e57a1fc4-0558-494c-ab77-77bebfba5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:47.100102 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e57a1fc4-0558-494c-ab77-77bebfba5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:47.100605 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e57a1fc4-0558-494c-ab77-77bebfba5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:47.104566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-ed3e60e3-955b-42bc-8053-8ec1e5a567d9 req-b26f08e1-ff41-42da-8d36-1e55e1823ecf service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:47.105178 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-ed3e60e3-955b-42bc-8053-8ec1e5a567d9 req-b26f08e1-ff41-42da-8d36-1e55e1823ecf service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:47.122522 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-ed3e60e3-955b-42bc-8053-8ec1e5a567d9 req-b26f08e1-ff41-42da-8d36-1e55e1823ecf service nova] Creating event network-vif-deleted:adc5b363-c80d-48e0-98dd-a4279791062f for instance abf3a64e-1d00-4751-816f-74abd2af6e39 on hv-cinder-79760 May 27 09:47:47.128477 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-ed3e60e3-955b-42bc-8053-8ec1e5a567d9 req-b26f08e1-ff41-42da-8d36-1e55e1823ecf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056440 May 27 09:47:47.129641 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 436/879] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:47.238390 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e57a1fc4-0558-494c-ab77-77bebfba5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:47.245799 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e57a1fc4-0558-494c-ab77-77bebfba5150 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1361 microversion: 2.1 time: 0.174422 May 27 09:47:47.246393 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 444/880] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:47 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:47.697152 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9779be7f-c976-4290-9cb7-4f2decbe69cf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:47.697760 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9779be7f-c976-4290-9cb7-4f2decbe69cf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] [instance: abf3a64e-1d00-4751-816f-74abd2af6e39] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:47.703912 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9779be7f-c976-4290-9cb7-4f2decbe69cf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:47.704384 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9779be7f-c976-4290-9cb7-4f2decbe69cf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:47.705142 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9779be7f-c976-4290-9cb7-4f2decbe69cf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:47.705576 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9779be7f-c976-4290-9cb7-4f2decbe69cf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:47.718501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-9779be7f-c976-4290-9cb7-4f2decbe69cf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] HTTP exception thrown: Instance abf3a64e-1d00-4751-816f-74abd2af6e39 could not be found. May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9779be7f-c976-4290-9cb7-4f2decbe69cf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Request method failure captured: May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 HTTP/1.1 May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJw8E69kc370trEXLpeY6UITestdwiquS5mhSQcfPgVOJi0R1BN1wUgAoLk7mJ_L26eDt4wZYQTLjuroG7w77s0HjSvRGsjWg8o4I5dW0q4LWmFIv0U1ANsH9YdQbasIIX2q8iO712z46SNFk9oHoWfSqkGNcR1-QodSA-SM0eE8kFI May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 0cad683f27d14cf5a90a19525a467a52 May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:47:47.720138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0cad683f27d14cf5a90a19525a467a52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0cad683f27d14cf5a90a19525a467a52"}]}] May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 0cad683f27d14cf5a90a19525a467a52 May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-221303946 May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-ServerRescueNegativeTestJSON-221303946-project May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 1331ba69eaec44dd9bd8f8db7d53ba5c May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-ServerRescueNegativeTestJSON-221303946-project May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance abf3a64e-1d00-4751-816f-74abd2af6e39 could not be found. May 27 09:47:47.721773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'abf3a64e-1d00-4751-816f-74abd2af6e39'} May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abf3a64e-1d00-4751-816f-74abd2af6e39 could not be found. May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:47:47.722663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abf3a64e-1d00-4751-816f-74abd2af6e39 could not be found. May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abf3a64e-1d00-4751-816f-74abd2af6e39 could not be found. May 27 09:47:47.724118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:47:47.725558 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9779be7f-c976-4290-9cb7-4f2decbe69cf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] Returning 404 to user: Instance abf3a64e-1d00-4751-816f-74abd2af6e39 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:47:47.725558 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9779be7f-c976-4290-9cb7-4f2decbe69cf tempest-ServerRescueNegativeTestJSON-221303946 tempest-ServerRescueNegativeTestJSON-221303946-project] 10.222.0.41 "GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39" status: 404 len: 111 microversion: 2.1 time: 0.028988 May 27 09:47:47.725558 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 437/881] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:47 2022] GET /compute/v2.1/servers/abf3a64e-1d00-4751-816f-74abd2af6e39 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:47:48.263727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fd258727-f91a-4e06-995e-7625f1d1dc3f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:48.264285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fd258727-f91a-4e06-995e-7625f1d1dc3f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:48.270720 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fd258727-f91a-4e06-995e-7625f1d1dc3f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:48.271181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fd258727-f91a-4e06-995e-7625f1d1dc3f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:48.272001 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fd258727-f91a-4e06-995e-7625f1d1dc3f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:48.272441 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fd258727-f91a-4e06-995e-7625f1d1dc3f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:48.402204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fd258727-f91a-4e06-995e-7625f1d1dc3f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:48.410229 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fd258727-f91a-4e06-995e-7625f1d1dc3f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1361 microversion: 2.1 time: 0.150500 May 27 09:47:48.410794 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 445/882] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:48 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:49.103702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-53dea5c6-f11c-4e88-88e1-236c015d5119 req-c3b888fe-0725-4d2b-b33f-7411958646e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ce3d24-302e-4c81-ae42-b0670172d8d6", "name": "network-vif-plugged", "status": "completed", "tag": "dc3fff52-3e58-4032-878e-443fd16673dd"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:49.110375 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=6 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:49.116127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-53dea5c6-f11c-4e88-88e1-236c015d5119 req-c3b888fe-0725-4d2b-b33f-7411958646e3 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:49.116575 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-53dea5c6-f11c-4e88-88e1-236c015d5119 req-c3b888fe-0725-4d2b-b33f-7411958646e3 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:49.130698 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-53dea5c6-f11c-4e88-88e1-236c015d5119 req-c3b888fe-0725-4d2b-b33f-7411958646e3 service nova] Creating event network-vif-plugged:dc3fff52-3e58-4032-878e-443fd16673dd for instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 on hv-cinder-79760 May 27 09:47:49.136078 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-53dea5c6-f11c-4e88-88e1-236c015d5119 req-c3b888fe-0725-4d2b-b33f-7411958646e3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036385 May 27 09:47:49.137189 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 438/883] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:49.427654 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-625a55f1-d2d6-4153-97dd-c7ce58b5257f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:49.428263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-625a55f1-d2d6-4153-97dd-c7ce58b5257f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:49.430202 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:49.431049 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=6 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:49.437141 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-625a55f1-d2d6-4153-97dd-c7ce58b5257f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:49.437638 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-625a55f1-d2d6-4153-97dd-c7ce58b5257f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:49.438553 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-625a55f1-d2d6-4153-97dd-c7ce58b5257f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:49.439853 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-625a55f1-d2d6-4153-97dd-c7ce58b5257f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:49.576772 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-625a55f1-d2d6-4153-97dd-c7ce58b5257f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:49.584244 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-625a55f1-d2d6-4153-97dd-c7ce58b5257f tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1361 microversion: 2.1 time: 0.161142 May 27 09:47:49.584816 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 446/884] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:49 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:50.602362 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4c9f71ee-0010-481b-a33e-a649490a7de9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:50.603049 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4c9f71ee-0010-481b-a33e-a649490a7de9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:50.609764 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4c9f71ee-0010-481b-a33e-a649490a7de9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:50.610160 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4c9f71ee-0010-481b-a33e-a649490a7de9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:50.610947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4c9f71ee-0010-481b-a33e-a649490a7de9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:50.611406 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4c9f71ee-0010-481b-a33e-a649490a7de9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:50.782836 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4c9f71ee-0010-481b-a33e-a649490a7de9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:50.791223 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4c9f71ee-0010-481b-a33e-a649490a7de9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1361 microversion: 2.1 time: 0.193360 May 27 09:47:50.792034 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 439/885] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:50 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:51.808445 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-67fa8c9b-4a5f-4f28-991b-fb1ad41302df tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:51.809072 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-67fa8c9b-4a5f-4f28-991b-fb1ad41302df tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:51.815654 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-67fa8c9b-4a5f-4f28-991b-fb1ad41302df tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:51.816413 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-67fa8c9b-4a5f-4f28-991b-fb1ad41302df tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:51.817022 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-67fa8c9b-4a5f-4f28-991b-fb1ad41302df tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:51.817451 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-67fa8c9b-4a5f-4f28-991b-fb1ad41302df tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:51.961944 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-67fa8c9b-4a5f-4f28-991b-fb1ad41302df tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:51.969772 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-67fa8c9b-4a5f-4f28-991b-fb1ad41302df tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1546 microversion: 2.1 time: 0.165499 May 27 09:47:51.970337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 447/886] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:51 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:51.986328 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-72a70602-e515-444b-a551-b53c0076357a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:51.986858 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-72a70602-e515-444b-a551-b53c0076357a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:51.993308 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-72a70602-e515-444b-a551-b53c0076357a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:51.993822 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-72a70602-e515-444b-a551-b53c0076357a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:51.994597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-72a70602-e515-444b-a551-b53c0076357a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:51.995038 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-72a70602-e515-444b-a551-b53c0076357a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:52.088556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-72a70602-e515-444b-a551-b53c0076357a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106292 May 27 09:47:52.089601 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 440/887] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 09:47:51 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:53.491020 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-2ba39848-7e82-4dba-a421-da6e07415d7f req-8c360f81-ca38-48d1-b263-50d19602be7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ce3d24-302e-4c81-ae42-b0670172d8d6", "tag": "dc3fff52-3e58-4032-878e-443fd16673dd"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:53.505262 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-2ba39848-7e82-4dba-a421-da6e07415d7f req-8c360f81-ca38-48d1-b263-50d19602be7d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:53.506604 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-2ba39848-7e82-4dba-a421-da6e07415d7f req-8c360f81-ca38-48d1-b263-50d19602be7d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:53.522252 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-2ba39848-7e82-4dba-a421-da6e07415d7f req-8c360f81-ca38-48d1-b263-50d19602be7d service nova] Creating event network-changed:dc3fff52-3e58-4032-878e-443fd16673dd for instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 on hv-cinder-79760 May 27 09:47:53.538507 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-2ba39848-7e82-4dba-a421-da6e07415d7f req-8c360f81-ca38-48d1-b263-50d19602be7d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220575 May 27 09:47:53.545042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 448/888] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:57.170387 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9a75f25a-d8f9-46bc-95ce-515267419dda tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: .version_select at 0x7f188c3a4af0>, body: {"keypair": {"name": "tempest-keypair-1767861587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDK2P/+ZhgWu1U8+6+77+QCmAFoNJc9Mnb9COaFbBhhwNqbr0oKTolbSEMyRqpPkOX/4y2p8VpVlShyRZQplUAu8QMT2+vnY/ZLTD/ceKbFr4YQAPsxLcPgd0r3zM9ptfg=="}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:57.185431 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-9a75f25a-d8f9-46bc-95ce-515267419dda tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for project 43091208be574e6e8cc348667792f751. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:47:57.189968 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-9a75f25a-d8f9-46bc-95ce-515267419dda tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for user 8d96e9d955934f0e883df57a3bcf934d and project 43091208be574e6e8cc348667792f751. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:47:57.212828 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9a75f25a-d8f9-46bc-95ce-515267419dda tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098006 May 27 09:47:57.213432 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 441/889] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 09:47:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:58.513012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-874947460", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f851c882-debd-4ebe-9da5-a1c317e6e8ac"}], "security_groups": [{"name": "tempest-securitygroup--1513665251"}], "key_name": "tempest-keypair-1767861587", "user_data": "}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:58.520125 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:58.620173 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] validate_networks() for [('f851c882-debd-4ebe-9da5-a1c317e6e8ac', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:47:58.996393 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:47:58.996879 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:47:58.997574 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:47:58.998051 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:47:58.998528 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:47:59.009163 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:59.009936 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:59.010949 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:59.011492 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:59.029402 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for project 43091208be574e6e8cc348667792f751. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:47:59.038692 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for user 8d96e9d955934f0e883df57a3bcf934d and project 43091208be574e6e8cc348667792f751. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:47:59.051420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:47:59.053789 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:47:59.104420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d68a73ab-3a2d-46ef-b807-89549480ccf0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.596720 May 27 09:47:59.105070 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 449/890] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:47:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 09:47:59.121610 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-987dd876-3ddd-4e99-adbc-fe65beaf77e0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:59.122407 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-987dd876-3ddd-4e99-adbc-fe65beaf77e0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:59.126865 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:59.194732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-987dd876-3ddd-4e99-adbc-fe65beaf77e0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:59.203155 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-987dd876-3ddd-4e99-adbc-fe65beaf77e0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1241 microversion: 2.1 time: 0.090653 May 27 09:47:59.204477 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 442/891] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:47:59 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:00.221583 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-72daf730-f201-49af-834a-c61f8e1316f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:00.222214 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-72daf730-f201-49af-834a-c61f8e1316f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:00.229749 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72daf730-f201-49af-834a-c61f8e1316f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:00.230498 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72daf730-f201-49af-834a-c61f8e1316f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:00.231511 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72daf730-f201-49af-834a-c61f8e1316f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:00.232110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72daf730-f201-49af-834a-c61f8e1316f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:00.352708 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-72daf730-f201-49af-834a-c61f8e1316f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:00.360795 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-72daf730-f201-49af-834a-c61f8e1316f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1301 microversion: 2.1 time: 0.143231 May 27 09:48:00.361372 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 450/892] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:00 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1301 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:01.378355 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-74cc5b0c-eb20-468b-9d81-3094826a0359 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:01.379127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-74cc5b0c-eb20-468b-9d81-3094826a0359 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:01.385674 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-74cc5b0c-eb20-468b-9d81-3094826a0359 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:01.386442 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-74cc5b0c-eb20-468b-9d81-3094826a0359 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:01.387321 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-74cc5b0c-eb20-468b-9d81-3094826a0359 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:01.387823 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-74cc5b0c-eb20-468b-9d81-3094826a0359 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:01.459752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-74cc5b0c-eb20-468b-9d81-3094826a0359 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:01.467501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-74cc5b0c-eb20-468b-9d81-3094826a0359 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1299 microversion: 2.1 time: 0.093157 May 27 09:48:01.468131 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 443/893] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:01 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:02.305972 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-325e2566-3de5-4b3b-8ec7-22798e0b075c req-e95f4a2e-9618-4a69-8376-e0e96ca3eed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2f121d-c06c-46e0-9e8b-455c50a5866f", "tag": "20d830c8-49a4-4ca7-8971-22159d9bd480"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:02.319175 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-325e2566-3de5-4b3b-8ec7-22798e0b075c req-e95f4a2e-9618-4a69-8376-e0e96ca3eed6 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:02.322076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-325e2566-3de5-4b3b-8ec7-22798e0b075c req-e95f4a2e-9618-4a69-8376-e0e96ca3eed6 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:02.334009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-325e2566-3de5-4b3b-8ec7-22798e0b075c req-e95f4a2e-9618-4a69-8376-e0e96ca3eed6 service nova] Creating event network-changed:20d830c8-49a4-4ca7-8971-22159d9bd480 for instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f on hv-cinder-79760 May 27 09:48:02.339327 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-325e2566-3de5-4b3b-8ec7-22798e0b075c req-e95f4a2e-9618-4a69-8376-e0e96ca3eed6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041511 May 27 09:48:02.339876 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 451/894] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:48:02.485047 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-652df7fe-3402-46f1-ac1d-9ef6a29c8cc0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:02.486283 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-652df7fe-3402-46f1-ac1d-9ef6a29c8cc0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:02.492966 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-652df7fe-3402-46f1-ac1d-9ef6a29c8cc0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:02.493506 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-652df7fe-3402-46f1-ac1d-9ef6a29c8cc0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:02.494356 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-652df7fe-3402-46f1-ac1d-9ef6a29c8cc0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:02.494853 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-652df7fe-3402-46f1-ac1d-9ef6a29c8cc0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:02.709507 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-652df7fe-3402-46f1-ac1d-9ef6a29c8cc0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:02.717217 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-652df7fe-3402-46f1-ac1d-9ef6a29c8cc0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1367 microversion: 2.1 time: 0.236123 May 27 09:48:02.717901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 444/895] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:02 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:03.735064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8f25fc0e-0b06-4bb3-97a9-3d0fc6d3e183 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:03.736301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8f25fc0e-0b06-4bb3-97a9-3d0fc6d3e183 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:03.742550 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f25fc0e-0b06-4bb3-97a9-3d0fc6d3e183 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:03.742999 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f25fc0e-0b06-4bb3-97a9-3d0fc6d3e183 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:03.743784 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f25fc0e-0b06-4bb3-97a9-3d0fc6d3e183 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:03.744218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8f25fc0e-0b06-4bb3-97a9-3d0fc6d3e183 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:03.887088 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8f25fc0e-0b06-4bb3-97a9-3d0fc6d3e183 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:03.894817 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8f25fc0e-0b06-4bb3-97a9-3d0fc6d3e183 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1367 microversion: 2.1 time: 0.164607 May 27 09:48:03.895415 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 452/896] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:03 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:04.911110 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4659a588-3a96-434f-9ca7-2b35c74176a0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:04.911707 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4659a588-3a96-434f-9ca7-2b35c74176a0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:04.918111 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4659a588-3a96-434f-9ca7-2b35c74176a0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:04.918557 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4659a588-3a96-434f-9ca7-2b35c74176a0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:04.919341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4659a588-3a96-434f-9ca7-2b35c74176a0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:04.919777 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4659a588-3a96-434f-9ca7-2b35c74176a0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:05.046819 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4659a588-3a96-434f-9ca7-2b35c74176a0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:05.054314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4659a588-3a96-434f-9ca7-2b35c74176a0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1367 microversion: 2.1 time: 0.147730 May 27 09:48:05.054873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 445/897] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:04 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:06.070864 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fb5861c8-8482-4817-86b3-85d0d349163f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:06.071510 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fb5861c8-8482-4817-86b3-85d0d349163f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:06.077874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb5861c8-8482-4817-86b3-85d0d349163f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:06.078318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb5861c8-8482-4817-86b3-85d0d349163f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:06.079072 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb5861c8-8482-4817-86b3-85d0d349163f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:06.080161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb5861c8-8482-4817-86b3-85d0d349163f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:06.207562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fb5861c8-8482-4817-86b3-85d0d349163f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:06.215159 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fb5861c8-8482-4817-86b3-85d0d349163f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1367 microversion: 2.1 time: 0.148119 May 27 09:48:06.215757 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 453/898] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:06 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:07.231718 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-aaa21c04-f8b1-40a0-b714-94e05b8a1b64 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:07.232331 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-aaa21c04-f8b1-40a0-b714-94e05b8a1b64 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:07.238548 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aaa21c04-f8b1-40a0-b714-94e05b8a1b64 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:07.238995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aaa21c04-f8b1-40a0-b714-94e05b8a1b64 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:07.239783 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aaa21c04-f8b1-40a0-b714-94e05b8a1b64 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:07.240216 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-aaa21c04-f8b1-40a0-b714-94e05b8a1b64 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:07.367527 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-aaa21c04-f8b1-40a0-b714-94e05b8a1b64 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:07.374912 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-aaa21c04-f8b1-40a0-b714-94e05b8a1b64 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1367 microversion: 2.1 time: 0.147127 May 27 09:48:07.375519 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 446/899] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:07 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:08.392953 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-27a100b4-812f-4dc3-88ad-3d4c6535b4d4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:08.393493 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-27a100b4-812f-4dc3-88ad-3d4c6535b4d4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:08.399855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-27a100b4-812f-4dc3-88ad-3d4c6535b4d4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:08.400301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-27a100b4-812f-4dc3-88ad-3d4c6535b4d4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:08.401055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-27a100b4-812f-4dc3-88ad-3d4c6535b4d4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:08.401491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-27a100b4-812f-4dc3-88ad-3d4c6535b4d4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:08.528405 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-27a100b4-812f-4dc3-88ad-3d4c6535b4d4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:08.535979 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-27a100b4-812f-4dc3-88ad-3d4c6535b4d4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1367 microversion: 2.1 time: 0.147547 May 27 09:48:08.536540 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 454/900] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:08 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:09.141271 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-5adb8a9d-2804-48b6-922c-251ea45d4e8c req-8b5a9007-739f-4c1b-8492-b823183db5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2f121d-c06c-46e0-9e8b-455c50a5866f", "name": "network-vif-plugged", "status": "completed", "tag": "20d830c8-49a4-4ca7-8971-22159d9bd480"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:09.151186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-5adb8a9d-2804-48b6-922c-251ea45d4e8c req-8b5a9007-739f-4c1b-8492-b823183db5ea service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:09.151661 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-5adb8a9d-2804-48b6-922c-251ea45d4e8c req-8b5a9007-739f-4c1b-8492-b823183db5ea service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:09.164141 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-5adb8a9d-2804-48b6-922c-251ea45d4e8c req-8b5a9007-739f-4c1b-8492-b823183db5ea service nova] Creating event network-vif-plugged:20d830c8-49a4-4ca7-8971-22159d9bd480 for instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f on hv-cinder-79760 May 27 09:48:09.169050 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-5adb8a9d-2804-48b6-922c-251ea45d4e8c req-8b5a9007-739f-4c1b-8492-b823183db5ea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031532 May 27 09:48:09.169852 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 447/901] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:48:09.551802 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b51421f8-61d1-4566-a9b5-3ba8a40b3048 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:09.552420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b51421f8-61d1-4566-a9b5-3ba8a40b3048 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:09.554331 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:09.554991 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=6 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:09.563334 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b51421f8-61d1-4566-a9b5-3ba8a40b3048 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:09.563786 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b51421f8-61d1-4566-a9b5-3ba8a40b3048 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:09.564558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b51421f8-61d1-4566-a9b5-3ba8a40b3048 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:09.564996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b51421f8-61d1-4566-a9b5-3ba8a40b3048 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:09.696020 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b51421f8-61d1-4566-a9b5-3ba8a40b3048 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:09.703511 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b51421f8-61d1-4566-a9b5-3ba8a40b3048 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1367 microversion: 2.1 time: 0.155493 May 27 09:48:09.704753 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 455/902] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:09 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:10.723127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=6 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:10.727968 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5a8c895e-aa0a-455d-8c16-27dcbb6dfcc4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:10.728696 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5a8c895e-aa0a-455d-8c16-27dcbb6dfcc4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:10.735739 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5a8c895e-aa0a-455d-8c16-27dcbb6dfcc4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:10.736192 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5a8c895e-aa0a-455d-8c16-27dcbb6dfcc4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:10.736955 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5a8c895e-aa0a-455d-8c16-27dcbb6dfcc4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:10.737396 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5a8c895e-aa0a-455d-8c16-27dcbb6dfcc4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:10.862669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5a8c895e-aa0a-455d-8c16-27dcbb6dfcc4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:10.870626 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5a8c895e-aa0a-455d-8c16-27dcbb6dfcc4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1367 microversion: 2.1 time: 0.148207 May 27 09:48:10.871353 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 448/903] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:10 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:11.887030 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-cfc87909-574b-4ca5-a301-b45046e371c3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:11.887656 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-cfc87909-574b-4ca5-a301-b45046e371c3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:11.894055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cfc87909-574b-4ca5-a301-b45046e371c3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:11.894495 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cfc87909-574b-4ca5-a301-b45046e371c3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:11.895249 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cfc87909-574b-4ca5-a301-b45046e371c3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:11.895703 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cfc87909-574b-4ca5-a301-b45046e371c3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:12.023740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cfc87909-574b-4ca5-a301-b45046e371c3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:12.027073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:12.032710 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-cfc87909-574b-4ca5-a301-b45046e371c3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1556 microversion: 2.1 time: 0.148989 May 27 09:48:12.033495 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 456/904] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:11 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:12.050150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f979f13c-7cce-4846-ab78-15206607ec3c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:12.050658 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f979f13c-7cce-4846-ab78-15206607ec3c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:12.057071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f979f13c-7cce-4846-ab78-15206607ec3c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:12.057523 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f979f13c-7cce-4846-ab78-15206607ec3c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:12.058285 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f979f13c-7cce-4846-ab78-15206607ec3c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:12.058724 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f979f13c-7cce-4846-ab78-15206607ec3c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:12.134257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f979f13c-7cce-4846-ab78-15206607ec3c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088602 May 27 09:48:12.134849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 449/905] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 09:48:12 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:48:13.030369 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-5a72c8bd-f3b2-4564-8c52-a71ba432e32c req-1760302d-316e-48cd-ac4b-115b5b830b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2f121d-c06c-46e0-9e8b-455c50a5866f", "tag": "20d830c8-49a4-4ca7-8971-22159d9bd480"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:13.040431 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-5a72c8bd-f3b2-4564-8c52-a71ba432e32c req-1760302d-316e-48cd-ac4b-115b5b830b2f service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:13.040967 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-5a72c8bd-f3b2-4564-8c52-a71ba432e32c req-1760302d-316e-48cd-ac4b-115b5b830b2f service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:13.052736 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-5a72c8bd-f3b2-4564-8c52-a71ba432e32c req-1760302d-316e-48cd-ac4b-115b5b830b2f service nova] Creating event network-changed:20d830c8-49a4-4ca7-8971-22159d9bd480 for instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f on hv-cinder-79760 May 27 09:48:13.057782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-5a72c8bd-f3b2-4564-8c52-a71ba432e32c req-1760302d-316e-48cd-ac4b-115b5b830b2f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032023 May 27 09:48:13.058712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 457/906] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:48:25.049285 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=17 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:25.050045 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=74 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:25.054543 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-43711a1d-dbcd-4d4b-9ae6-db0845a43bca tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:25.055072 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-43711a1d-dbcd-4d4b-9ae6-db0845a43bca tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:25.061884 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-43711a1d-dbcd-4d4b-9ae6-db0845a43bca tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:25.062451 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-43711a1d-dbcd-4d4b-9ae6-db0845a43bca tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:25.063923 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-43711a1d-dbcd-4d4b-9ae6-db0845a43bca tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:25.064494 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-43711a1d-dbcd-4d4b-9ae6-db0845a43bca tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:25.087847 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-43711a1d-dbcd-4d4b-9ae6-db0845a43bca tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lazy-loading 'flavor' on Instance uuid 74dd536e-b54a-4af0-8010-b44bca82fbe9 {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:48:25.160886 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-43711a1d-dbcd-4d4b-9ae6-db0845a43bca tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "POST /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9/action" status: 202 len: 0 microversion: 2.1 time: 0.112634 May 27 09:48:25.161578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 450/907] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:48:25 2022] POST /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:48:25.167648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:25.168406 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:25.172856 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7e0134b6-c586-424b-a4e0-ab338cd0d7f7 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:25.173552 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7e0134b6-c586-424b-a4e0-ab338cd0d7f7 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:25.181095 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7e0134b6-c586-424b-a4e0-ab338cd0d7f7 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:25.181561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7e0134b6-c586-424b-a4e0-ab338cd0d7f7 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:25.182309 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7e0134b6-c586-424b-a4e0-ab338cd0d7f7 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:25.182736 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7e0134b6-c586-424b-a4e0-ab338cd0d7f7 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:25.314476 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7e0134b6-c586-424b-a4e0-ab338cd0d7f7 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:25.321996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7e0134b6-c586-424b-a4e0-ab338cd0d7f7 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.156009 May 27 09:48:25.322552 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 458/908] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:25 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:26.340753 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-bfcf668c-5cdf-48f9-876a-f0e876b0e57f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:26.341371 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bfcf668c-5cdf-48f9-876a-f0e876b0e57f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:26.347596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bfcf668c-5cdf-48f9-876a-f0e876b0e57f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:26.348048 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bfcf668c-5cdf-48f9-876a-f0e876b0e57f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:26.348819 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bfcf668c-5cdf-48f9-876a-f0e876b0e57f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:26.349258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bfcf668c-5cdf-48f9-876a-f0e876b0e57f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:26.481045 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bfcf668c-5cdf-48f9-876a-f0e876b0e57f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:26.488434 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-bfcf668c-5cdf-48f9-876a-f0e876b0e57f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.152697 May 27 09:48:26.489001 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 451/909] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:26 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:26.850630 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-45bde113-569e-4e52-9ad4-3cf088c8cd7a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:26.851195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-45bde113-569e-4e52-9ad4-3cf088c8cd7a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:26.857607 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-45bde113-569e-4e52-9ad4-3cf088c8cd7a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:26.858074 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-45bde113-569e-4e52-9ad4-3cf088c8cd7a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:26.858823 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-45bde113-569e-4e52-9ad4-3cf088c8cd7a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:26.859253 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-45bde113-569e-4e52-9ad4-3cf088c8cd7a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:26.883969 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-45bde113-569e-4e52-9ad4-3cf088c8cd7a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/ips" status: 200 len: 150 microversion: 2.20 time: 0.037212 May 27 09:48:26.884530 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 459/910] 10.222.0.41 () {60 vars in 1288 bytes} [Fri May 27 09:48:26 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:48:27.504969 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d4dd3ab4-f095-49bb-ac9c-14ebdf0493c8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:27.505504 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d4dd3ab4-f095-49bb-ac9c-14ebdf0493c8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:27.512156 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4dd3ab4-f095-49bb-ac9c-14ebdf0493c8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:27.512613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4dd3ab4-f095-49bb-ac9c-14ebdf0493c8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:27.513380 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4dd3ab4-f095-49bb-ac9c-14ebdf0493c8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:27.513821 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d4dd3ab4-f095-49bb-ac9c-14ebdf0493c8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:27.884683 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d4dd3ab4-f095-49bb-ac9c-14ebdf0493c8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:27.892865 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d4dd3ab4-f095-49bb-ac9c-14ebdf0493c8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.391869 May 27 09:48:27.893433 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 452/911] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:27 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:28.685410 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f29cf67c-22bb-4e3f-bf1a-e4ebe2f1a792 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:28.685983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f29cf67c-22bb-4e3f-bf1a-e4ebe2f1a792 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:28.692983 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f29cf67c-22bb-4e3f-bf1a-e4ebe2f1a792 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:28.693429 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f29cf67c-22bb-4e3f-bf1a-e4ebe2f1a792 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:28.694188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f29cf67c-22bb-4e3f-bf1a-e4ebe2f1a792 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:28.694621 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f29cf67c-22bb-4e3f-bf1a-e4ebe2f1a792 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:28.717293 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-f29cf67c-22bb-4e3f-bf1a-e4ebe2f1a792 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lazy-loading 'flavor' on Instance uuid 330ed71b-ab48-42b7-b46e-98be00f7343e {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:48:28.910087 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7a4f0b39-0e44-4b0b-bb8b-80ce62623900 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:28.910696 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7a4f0b39-0e44-4b0b-bb8b-80ce62623900 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:28.917100 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7a4f0b39-0e44-4b0b-bb8b-80ce62623900 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:28.917546 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7a4f0b39-0e44-4b0b-bb8b-80ce62623900 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:28.918494 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7a4f0b39-0e44-4b0b-bb8b-80ce62623900 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:28.918940 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7a4f0b39-0e44-4b0b-bb8b-80ce62623900 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:28.971249 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f29cf67c-22bb-4e3f-bf1a-e4ebe2f1a792 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/action" status: 202 len: 0 microversion: 2.20 time: 0.289548 May 27 09:48:28.974836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 460/912] 10.222.0.41 () {62 vars in 1318 bytes} [Fri May 27 09:48:28 2022] POST /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 09:48:28.980207 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-957fe6a3-daaf-4313-b1af-2b265b311b92 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:28.981446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-957fe6a3-daaf-4313-b1af-2b265b311b92 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:28.987422 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-957fe6a3-daaf-4313-b1af-2b265b311b92 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:28.988009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-957fe6a3-daaf-4313-b1af-2b265b311b92 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:28.988916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-957fe6a3-daaf-4313-b1af-2b265b311b92 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:28.989378 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-957fe6a3-daaf-4313-b1af-2b265b311b92 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:29.099118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7a4f0b39-0e44-4b0b-bb8b-80ce62623900 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:29.106898 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7a4f0b39-0e44-4b0b-bb8b-80ce62623900 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.201116 May 27 09:48:29.107727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 453/913] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:28 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:29.141696 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-957fe6a3-daaf-4313-b1af-2b265b311b92 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:29.149660 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-957fe6a3-daaf-4313-b1af-2b265b311b92 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:29.151173 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-957fe6a3-daaf-4313-b1af-2b265b311b92 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:29.152363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-957fe6a3-daaf-4313-b1af-2b265b311b92 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.176263 May 27 09:48:29.152927 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 461/914] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:28 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:30.124370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8c9e1c2a-4b63-49e8-95a6-4f84a1493657 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:30.124986 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8c9e1c2a-4b63-49e8-95a6-4f84a1493657 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:30.131537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c9e1c2a-4b63-49e8-95a6-4f84a1493657 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:30.131987 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c9e1c2a-4b63-49e8-95a6-4f84a1493657 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:30.132750 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c9e1c2a-4b63-49e8-95a6-4f84a1493657 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:30.133187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c9e1c2a-4b63-49e8-95a6-4f84a1493657 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:30.176199 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-74f95b26-54ee-4ab3-acc5-842f90ceb561 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:30.176917 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-74f95b26-54ee-4ab3-acc5-842f90ceb561 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:30.183440 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-74f95b26-54ee-4ab3-acc5-842f90ceb561 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:30.183972 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-74f95b26-54ee-4ab3-acc5-842f90ceb561 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:30.184797 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-74f95b26-54ee-4ab3-acc5-842f90ceb561 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:30.185235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-74f95b26-54ee-4ab3-acc5-842f90ceb561 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:30.311740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8c9e1c2a-4b63-49e8-95a6-4f84a1493657 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:30.319302 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8c9e1c2a-4b63-49e8-95a6-4f84a1493657 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.198723 May 27 09:48:30.320012 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 454/915] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:30 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:30.345849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-74f95b26-54ee-4ab3-acc5-842f90ceb561 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:30.353664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-74f95b26-54ee-4ab3-acc5-842f90ceb561 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:30.355152 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-74f95b26-54ee-4ab3-acc5-842f90ceb561 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:30.356337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-74f95b26-54ee-4ab3-acc5-842f90ceb561 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.184750 May 27 09:48:30.356890 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 462/916] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:30 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:31.336293 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d5007472-e9d5-422b-907c-743c8389dabb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:31.336851 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d5007472-e9d5-422b-907c-743c8389dabb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:31.343568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d5007472-e9d5-422b-907c-743c8389dabb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:31.344022 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d5007472-e9d5-422b-907c-743c8389dabb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:31.344787 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d5007472-e9d5-422b-907c-743c8389dabb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:31.345264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d5007472-e9d5-422b-907c-743c8389dabb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:31.375200 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0a2cc88f-aa20-43b9-a55a-0660eb43e787 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:31.375849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0a2cc88f-aa20-43b9-a55a-0660eb43e787 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:31.382964 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0a2cc88f-aa20-43b9-a55a-0660eb43e787 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:31.383468 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0a2cc88f-aa20-43b9-a55a-0660eb43e787 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:31.384242 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0a2cc88f-aa20-43b9-a55a-0660eb43e787 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:31.384686 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0a2cc88f-aa20-43b9-a55a-0660eb43e787 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:31.519893 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d5007472-e9d5-422b-907c-743c8389dabb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:31.527266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d5007472-e9d5-422b-907c-743c8389dabb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.194866 May 27 09:48:31.527862 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 455/917] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:31 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:31.554915 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0a2cc88f-aa20-43b9-a55a-0660eb43e787 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:31.562735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0a2cc88f-aa20-43b9-a55a-0660eb43e787 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:31.564263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0a2cc88f-aa20-43b9-a55a-0660eb43e787 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:31.565413 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0a2cc88f-aa20-43b9-a55a-0660eb43e787 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.194124 May 27 09:48:31.565975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 463/918] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:31 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:32.544854 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-56358b88-faab-4b9a-a544-f1976d81ee0b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:32.545469 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-56358b88-faab-4b9a-a544-f1976d81ee0b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:32.553199 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-56358b88-faab-4b9a-a544-f1976d81ee0b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:32.553650 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-56358b88-faab-4b9a-a544-f1976d81ee0b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:32.554587 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-56358b88-faab-4b9a-a544-f1976d81ee0b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:32.554854 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-56358b88-faab-4b9a-a544-f1976d81ee0b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:32.583879 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c5f8336c-86f5-4b3b-8c8b-1478bddf5022 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:32.584493 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c5f8336c-86f5-4b3b-8c8b-1478bddf5022 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:32.591513 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c5f8336c-86f5-4b3b-8c8b-1478bddf5022 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:32.591962 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c5f8336c-86f5-4b3b-8c8b-1478bddf5022 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:32.592719 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c5f8336c-86f5-4b3b-8c8b-1478bddf5022 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:32.593149 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c5f8336c-86f5-4b3b-8c8b-1478bddf5022 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:32.736247 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-56358b88-faab-4b9a-a544-f1976d81ee0b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:32.743738 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-56358b88-faab-4b9a-a544-f1976d81ee0b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.202756 May 27 09:48:32.744321 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 456/919] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:32 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:32.763104 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c5f8336c-86f5-4b3b-8c8b-1478bddf5022 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:32.771481 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c5f8336c-86f5-4b3b-8c8b-1478bddf5022 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:32.772973 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c5f8336c-86f5-4b3b-8c8b-1478bddf5022 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:32.774188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c5f8336c-86f5-4b3b-8c8b-1478bddf5022 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.194295 May 27 09:48:32.774732 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 464/920] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:32 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:33.759773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2b1ad1b2-b360-4371-9eb9-3513564238bb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:33.760378 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2b1ad1b2-b360-4371-9eb9-3513564238bb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:33.767387 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2b1ad1b2-b360-4371-9eb9-3513564238bb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:33.767843 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2b1ad1b2-b360-4371-9eb9-3513564238bb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:33.768604 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2b1ad1b2-b360-4371-9eb9-3513564238bb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:33.769036 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2b1ad1b2-b360-4371-9eb9-3513564238bb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:33.792606 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a0c816fb-bedb-46f8-b825-8f13647d4335 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:33.793207 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a0c816fb-bedb-46f8-b825-8f13647d4335 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:33.799657 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a0c816fb-bedb-46f8-b825-8f13647d4335 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:33.800100 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a0c816fb-bedb-46f8-b825-8f13647d4335 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:33.800862 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a0c816fb-bedb-46f8-b825-8f13647d4335 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:33.801292 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a0c816fb-bedb-46f8-b825-8f13647d4335 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:33.948634 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-2b1ad1b2-b360-4371-9eb9-3513564238bb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:33.956597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2b1ad1b2-b360-4371-9eb9-3513564238bb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.200652 May 27 09:48:33.957175 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 457/921] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:33 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:33.978838 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a0c816fb-bedb-46f8-b825-8f13647d4335 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:33.986703 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a0c816fb-bedb-46f8-b825-8f13647d4335 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:33.988229 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a0c816fb-bedb-46f8-b825-8f13647d4335 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:33.989402 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a0c816fb-bedb-46f8-b825-8f13647d4335 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.200592 May 27 09:48:33.989942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 465/922] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:33 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:34.974497 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ddbfbae4-b853-4593-9f6e-de9ea24d2b1b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:34.975170 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ddbfbae4-b853-4593-9f6e-de9ea24d2b1b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:34.981656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ddbfbae4-b853-4593-9f6e-de9ea24d2b1b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:34.982106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ddbfbae4-b853-4593-9f6e-de9ea24d2b1b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:34.982867 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ddbfbae4-b853-4593-9f6e-de9ea24d2b1b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:34.983324 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ddbfbae4-b853-4593-9f6e-de9ea24d2b1b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:35.006875 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9ab69406-d7cd-4ea3-ad27-dcb252bd8d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:35.007508 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9ab69406-d7cd-4ea3-ad27-dcb252bd8d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:35.013892 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ab69406-d7cd-4ea3-ad27-dcb252bd8d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:35.014343 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ab69406-d7cd-4ea3-ad27-dcb252bd8d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:35.015111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ab69406-d7cd-4ea3-ad27-dcb252bd8d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:35.015581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ab69406-d7cd-4ea3-ad27-dcb252bd8d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:35.164920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ddbfbae4-b853-4593-9f6e-de9ea24d2b1b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:35.172855 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ddbfbae4-b853-4593-9f6e-de9ea24d2b1b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.202820 May 27 09:48:35.173437 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 458/923] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:34 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:35.199231 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9ab69406-d7cd-4ea3-ad27-dcb252bd8d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:35.207685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9ab69406-d7cd-4ea3-ad27-dcb252bd8d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:35.209188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9ab69406-d7cd-4ea3-ad27-dcb252bd8d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:35.210338 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9ab69406-d7cd-4ea3-ad27-dcb252bd8d9d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.207285 May 27 09:48:35.210899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 466/924] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:35 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:36.193808 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c1e274a1-a6ca-4955-8e7d-48c0efc27cc8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:36.194424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c1e274a1-a6ca-4955-8e7d-48c0efc27cc8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:36.201238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1e274a1-a6ca-4955-8e7d-48c0efc27cc8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:36.201879 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1e274a1-a6ca-4955-8e7d-48c0efc27cc8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:36.202352 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1e274a1-a6ca-4955-8e7d-48c0efc27cc8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:36.202832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c1e274a1-a6ca-4955-8e7d-48c0efc27cc8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:36.229358 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e2cfefdd-ff75-4e4f-8055-0d723d56d6be tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:36.229972 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e2cfefdd-ff75-4e4f-8055-0d723d56d6be tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:36.236393 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e2cfefdd-ff75-4e4f-8055-0d723d56d6be tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:36.237435 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e2cfefdd-ff75-4e4f-8055-0d723d56d6be tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:36.238215 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e2cfefdd-ff75-4e4f-8055-0d723d56d6be tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:36.238649 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e2cfefdd-ff75-4e4f-8055-0d723d56d6be tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:36.406329 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c1e274a1-a6ca-4955-8e7d-48c0efc27cc8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:36.409888 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e2cfefdd-ff75-4e4f-8055-0d723d56d6be tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:36.414459 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c1e274a1-a6ca-4955-8e7d-48c0efc27cc8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.224505 May 27 09:48:36.415216 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 459/925] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:36 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:36.418228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e2cfefdd-ff75-4e4f-8055-0d723d56d6be tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:36.419952 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e2cfefdd-ff75-4e4f-8055-0d723d56d6be tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:36.421139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e2cfefdd-ff75-4e4f-8055-0d723d56d6be tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.195724 May 27 09:48:36.421675 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 467/926] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:36 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:37.431064 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6f748306-bffc-4ced-ac6d-3a7288d5901b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:37.433034 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6f748306-bffc-4ced-ac6d-3a7288d5901b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:37.437627 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6f748306-bffc-4ced-ac6d-3a7288d5901b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:37.438003 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6799af1a-68a1-44e5-8f27-47fa37e4cadc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:37.438414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6f748306-bffc-4ced-ac6d-3a7288d5901b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:37.438613 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6799af1a-68a1-44e5-8f27-47fa37e4cadc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:37.438813 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6f748306-bffc-4ced-ac6d-3a7288d5901b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:37.439246 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6f748306-bffc-4ced-ac6d-3a7288d5901b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:37.445423 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6799af1a-68a1-44e5-8f27-47fa37e4cadc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:37.445873 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6799af1a-68a1-44e5-8f27-47fa37e4cadc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:37.446653 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6799af1a-68a1-44e5-8f27-47fa37e4cadc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:37.447088 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6799af1a-68a1-44e5-8f27-47fa37e4cadc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:37.634393 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6f748306-bffc-4ced-ac6d-3a7288d5901b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:37.637393 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6799af1a-68a1-44e5-8f27-47fa37e4cadc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:37.642035 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6f748306-bffc-4ced-ac6d-3a7288d5901b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.214825 May 27 09:48:37.642599 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 460/927] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:37 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:37.645356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6799af1a-68a1-44e5-8f27-47fa37e4cadc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:37.646849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6799af1a-68a1-44e5-8f27-47fa37e4cadc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:37.648027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6799af1a-68a1-44e5-8f27-47fa37e4cadc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.213863 May 27 09:48:37.648573 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 468/928] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:37 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:38.658943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0b6e462b-3927-4c98-a84d-36a09803f4b9 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:38.659584 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0b6e462b-3927-4c98-a84d-36a09803f4b9 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:38.665590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4986100a-272d-4e85-b650-37107fd399f7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:38.666058 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b6e462b-3927-4c98-a84d-36a09803f4b9 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:38.666310 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4986100a-272d-4e85-b650-37107fd399f7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:38.666514 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b6e462b-3927-4c98-a84d-36a09803f4b9 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:38.667314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b6e462b-3927-4c98-a84d-36a09803f4b9 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:38.667739 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0b6e462b-3927-4c98-a84d-36a09803f4b9 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:38.672572 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4986100a-272d-4e85-b650-37107fd399f7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:38.673014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4986100a-272d-4e85-b650-37107fd399f7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:38.673769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4986100a-272d-4e85-b650-37107fd399f7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:38.674724 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4986100a-272d-4e85-b650-37107fd399f7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:38.870119 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0b6e462b-3927-4c98-a84d-36a09803f4b9 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:38.874389 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4986100a-272d-4e85-b650-37107fd399f7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:38.879610 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0b6e462b-3927-4c98-a84d-36a09803f4b9 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.224427 May 27 09:48:38.880292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 461/929] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:38 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:38.883513 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4986100a-272d-4e85-b650-37107fd399f7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:38.884998 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4986100a-272d-4e85-b650-37107fd399f7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:38.886166 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4986100a-272d-4e85-b650-37107fd399f7 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.224431 May 27 09:48:38.886705 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 469/930] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:38 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:39.897372 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-de8a357b-a7e4-4e0d-b6bc-284782184159 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:39.897974 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-de8a357b-a7e4-4e0d-b6bc-284782184159 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:39.904070 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f8db5bd7-1044-47fc-babc-985db36ee01d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:39.904679 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f8db5bd7-1044-47fc-babc-985db36ee01d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:39.905017 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-de8a357b-a7e4-4e0d-b6bc-284782184159 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:39.905503 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-de8a357b-a7e4-4e0d-b6bc-284782184159 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:39.906281 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-de8a357b-a7e4-4e0d-b6bc-284782184159 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:39.906726 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-de8a357b-a7e4-4e0d-b6bc-284782184159 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:39.911012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f8db5bd7-1044-47fc-babc-985db36ee01d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:39.911498 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f8db5bd7-1044-47fc-babc-985db36ee01d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:39.912270 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f8db5bd7-1044-47fc-babc-985db36ee01d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:39.912707 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f8db5bd7-1044-47fc-babc-985db36ee01d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:40.101033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-de8a357b-a7e4-4e0d-b6bc-284782184159 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:40.107768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f8db5bd7-1044-47fc-babc-985db36ee01d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:40.108695 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-de8a357b-a7e4-4e0d-b6bc-284782184159 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.215791 May 27 09:48:40.109266 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 462/931] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:39 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:40.116390 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f8db5bd7-1044-47fc-babc-985db36ee01d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:40.117880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f8db5bd7-1044-47fc-babc-985db36ee01d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:40.119035 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f8db5bd7-1044-47fc-babc-985db36ee01d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.218886 May 27 09:48:40.119618 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 470/932] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:39 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:41.125846 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-20fa94fc-7cf5-4393-81f9-ab37511a605a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:41.126455 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-20fa94fc-7cf5-4393-81f9-ab37511a605a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:41.132828 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-20fa94fc-7cf5-4393-81f9-ab37511a605a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:41.133276 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-20fa94fc-7cf5-4393-81f9-ab37511a605a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:41.134040 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-20fa94fc-7cf5-4393-81f9-ab37511a605a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:41.134476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-20fa94fc-7cf5-4393-81f9-ab37511a605a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:41.137438 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-cc75a3db-fa59-40f8-9f98-0b294669b11d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:41.138072 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-cc75a3db-fa59-40f8-9f98-0b294669b11d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:41.144996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cc75a3db-fa59-40f8-9f98-0b294669b11d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:41.145446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cc75a3db-fa59-40f8-9f98-0b294669b11d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:41.146212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cc75a3db-fa59-40f8-9f98-0b294669b11d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:41.146649 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cc75a3db-fa59-40f8-9f98-0b294669b11d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:41.343056 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-20fa94fc-7cf5-4393-81f9-ab37511a605a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:41.346413 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cc75a3db-fa59-40f8-9f98-0b294669b11d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:41.350628 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-20fa94fc-7cf5-4393-81f9-ab37511a605a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.228613 May 27 09:48:41.351195 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 463/933] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:41 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:41.354434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cc75a3db-fa59-40f8-9f98-0b294669b11d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:41.355947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cc75a3db-fa59-40f8-9f98-0b294669b11d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:41.357090 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-cc75a3db-fa59-40f8-9f98-0b294669b11d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1742 microversion: 2.20 time: 0.223526 May 27 09:48:41.357624 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 471/934] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:41 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1742 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:42.367946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cda89ad5-2363-43d9-b29b-7fedffcc118e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:42.368499 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cda89ad5-2363-43d9-b29b-7fedffcc118e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:42.374910 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cda89ad5-2363-43d9-b29b-7fedffcc118e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:42.375085 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-20974fbc-ecb3-4028-a410-fad1bc107be1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:42.375532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cda89ad5-2363-43d9-b29b-7fedffcc118e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:42.375651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-20974fbc-ecb3-4028-a410-fad1bc107be1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:42.376138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cda89ad5-2363-43d9-b29b-7fedffcc118e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:42.376570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cda89ad5-2363-43d9-b29b-7fedffcc118e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:42.382034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20974fbc-ecb3-4028-a410-fad1bc107be1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:42.382482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20974fbc-ecb3-4028-a410-fad1bc107be1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:42.383244 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20974fbc-ecb3-4028-a410-fad1bc107be1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:42.383704 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20974fbc-ecb3-4028-a410-fad1bc107be1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:42.394731 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:42.571082 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cda89ad5-2363-43d9-b29b-7fedffcc118e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:42.574282 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-20974fbc-ecb3-4028-a410-fad1bc107be1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:42.577898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:42.581383 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cda89ad5-2363-43d9-b29b-7fedffcc118e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.216787 May 27 09:48:42.581970 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 464/935] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:42 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:42.584942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-20974fbc-ecb3-4028-a410-fad1bc107be1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:42.586434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-20974fbc-ecb3-4028-a410-fad1bc107be1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:42.587625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-20974fbc-ecb3-4028-a410-fad1bc107be1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1742 microversion: 2.20 time: 0.216517 May 27 09:48:42.588175 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 472/936] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:42 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1742 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:43.601532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-31e60bef-942d-4f0b-a345-cf55437c597b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:43.602434 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-31e60bef-942d-4f0b-a345-cf55437c597b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:43.606752 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-be6f6bff-0a57-4c02-a061-de6b83a21ee5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:43.607602 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-be6f6bff-0a57-4c02-a061-de6b83a21ee5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:43.609207 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-31e60bef-942d-4f0b-a345-cf55437c597b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:43.609521 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-31e60bef-942d-4f0b-a345-cf55437c597b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:43.610522 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-31e60bef-942d-4f0b-a345-cf55437c597b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:43.610794 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-31e60bef-942d-4f0b-a345-cf55437c597b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:43.615797 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be6f6bff-0a57-4c02-a061-de6b83a21ee5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:43.616258 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be6f6bff-0a57-4c02-a061-de6b83a21ee5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:43.617041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be6f6bff-0a57-4c02-a061-de6b83a21ee5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:43.617645 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-be6f6bff-0a57-4c02-a061-de6b83a21ee5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:43.811490 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-31e60bef-942d-4f0b-a345-cf55437c597b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:43.814725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-be6f6bff-0a57-4c02-a061-de6b83a21ee5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:43.819514 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-31e60bef-942d-4f0b-a345-cf55437c597b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1570 microversion: 2.1 time: 0.221889 May 27 09:48:43.820082 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 465/937] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:43 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:43.823373 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-be6f6bff-0a57-4c02-a061-de6b83a21ee5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:43.824880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-be6f6bff-0a57-4c02-a061-de6b83a21ee5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:43.826037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-be6f6bff-0a57-4c02-a061-de6b83a21ee5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1742 microversion: 2.20 time: 0.223114 May 27 09:48:43.828809 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 473/938] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:43 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1742 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:43.836146 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5213ad56-f3a7-4264-aca8-e3417ec5f1f1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:43.836720 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5213ad56-f3a7-4264-aca8-e3417ec5f1f1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:43.843005 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5213ad56-f3a7-4264-aca8-e3417ec5f1f1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:43.843526 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5213ad56-f3a7-4264-aca8-e3417ec5f1f1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:43.844294 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5213ad56-f3a7-4264-aca8-e3417ec5f1f1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:43.844729 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5213ad56-f3a7-4264-aca8-e3417ec5f1f1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:43.922314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5213ad56-f3a7-4264-aca8-e3417ec5f1f1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "POST /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9/action" status: 202 len: 0 microversion: 2.1 time: 0.089903 May 27 09:48:43.922952 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 466/939] 10.222.0.41 () {60 vars in 1277 bytes} [Fri May 27 09:48:43 2022] POST /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 09:48:43.931450 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-844b1192-b9cc-4544-add3-e8b6e2b1c677 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:43.932059 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-844b1192-b9cc-4544-add3-e8b6e2b1c677 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:43.937951 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-844b1192-b9cc-4544-add3-e8b6e2b1c677 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:43.938395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-844b1192-b9cc-4544-add3-e8b6e2b1c677 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:43.939151 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-844b1192-b9cc-4544-add3-e8b6e2b1c677 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:43.939609 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-844b1192-b9cc-4544-add3-e8b6e2b1c677 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:44.078596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-844b1192-b9cc-4544-add3-e8b6e2b1c677 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:44.086220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-844b1192-b9cc-4544-add3-e8b6e2b1c677 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1518 microversion: 2.1 time: 0.158562 May 27 09:48:44.086782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 474/940] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:43 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:44.845018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cd32a51b-890b-4827-9735-4a13a79e4f5b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:44.845549 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cd32a51b-890b-4827-9735-4a13a79e4f5b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:44.852215 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cd32a51b-890b-4827-9735-4a13a79e4f5b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:44.852669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cd32a51b-890b-4827-9735-4a13a79e4f5b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:44.853437 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cd32a51b-890b-4827-9735-4a13a79e4f5b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:44.853879 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cd32a51b-890b-4827-9735-4a13a79e4f5b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:44.982661 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cd32a51b-890b-4827-9735-4a13a79e4f5b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:44.991134 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cd32a51b-890b-4827-9735-4a13a79e4f5b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:44.992649 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cd32a51b-890b-4827-9735-4a13a79e4f5b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:44.994026 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cd32a51b-890b-4827-9735-4a13a79e4f5b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1742 microversion: 2.20 time: 0.152787 May 27 09:48:44.994599 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 467/941] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:44 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1742 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:45.104393 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2b6e16bb-de87-4b0a-a46c-cbdc76ebb048 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:45.104933 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2b6e16bb-de87-4b0a-a46c-cbdc76ebb048 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:45.111319 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2b6e16bb-de87-4b0a-a46c-cbdc76ebb048 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:45.112342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2b6e16bb-de87-4b0a-a46c-cbdc76ebb048 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:45.113111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2b6e16bb-de87-4b0a-a46c-cbdc76ebb048 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:45.113548 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2b6e16bb-de87-4b0a-a46c-cbdc76ebb048 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:45.249676 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-291f1351-f12e-4b4c-934b-ed41dd603a62 req-0bd59fbe-2401-4bf9-98fe-00eeda82f998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330ed71b-ab48-42b7-b46e-98be00f7343e", "name": "network-vif-plugged", "status": "completed", "tag": "9011439f-1b54-4948-87ab-dd7cd4f186e5"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:45.262491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2b6e16bb-de87-4b0a-a46c-cbdc76ebb048 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:45.264776 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-291f1351-f12e-4b4c-934b-ed41dd603a62 req-0bd59fbe-2401-4bf9-98fe-00eeda82f998 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:45.265595 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-291f1351-f12e-4b4c-934b-ed41dd603a62 req-0bd59fbe-2401-4bf9-98fe-00eeda82f998 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:45.271770 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2b6e16bb-de87-4b0a-a46c-cbdc76ebb048 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1520 microversion: 2.1 time: 0.171195 May 27 09:48:45.272343 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 475/942] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:45 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:48:45.278231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-291f1351-f12e-4b4c-934b-ed41dd603a62 req-0bd59fbe-2401-4bf9-98fe-00eeda82f998 service nova] Creating event network-vif-plugged:9011439f-1b54-4948-87ab-dd7cd4f186e5 for instance 330ed71b-ab48-42b7-b46e-98be00f7343e on hv-cinder-79760 May 27 09:48:45.284580 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-291f1351-f12e-4b4c-934b-ed41dd603a62 req-0bd59fbe-2401-4bf9-98fe-00eeda82f998 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038436 May 27 09:48:45.285414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 468/943] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:48:46.012395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a054d933-01b5-4e88-b4d2-236c75f383d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:46.013023 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a054d933-01b5-4e88-b4d2-236c75f383d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:46.019687 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a054d933-01b5-4e88-b4d2-236c75f383d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:46.020133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a054d933-01b5-4e88-b4d2-236c75f383d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:46.020909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a054d933-01b5-4e88-b4d2-236c75f383d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:46.021349 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a054d933-01b5-4e88-b4d2-236c75f383d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:46.206198 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a054d933-01b5-4e88-b4d2-236c75f383d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:46.215934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a054d933-01b5-4e88-b4d2-236c75f383d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:46.217436 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a054d933-01b5-4e88-b4d2-236c75f383d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:46.218599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a054d933-01b5-4e88-b4d2-236c75f383d9 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1742 microversion: 2.20 time: 0.210099 May 27 09:48:46.219156 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 476/944] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:46 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1742 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:46.290393 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-7fcefae2-acca-492d-bcf8-b0339bda3a78 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:46.291340 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-7fcefae2-acca-492d-bcf8-b0339bda3a78 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:46.297493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fcefae2-acca-492d-bcf8-b0339bda3a78 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:46.297945 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fcefae2-acca-492d-bcf8-b0339bda3a78 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:46.298715 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fcefae2-acca-492d-bcf8-b0339bda3a78 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:46.299724 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-7fcefae2-acca-492d-bcf8-b0339bda3a78 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:46.497750 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-7fcefae2-acca-492d-bcf8-b0339bda3a78 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:46.505218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-7fcefae2-acca-492d-bcf8-b0339bda3a78 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.219639 May 27 09:48:46.505866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 469/945] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:46 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:47.237540 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b762858b-6c04-48a2-9188-cbbbaa49788f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:47.238150 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b762858b-6c04-48a2-9188-cbbbaa49788f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:47.244793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b762858b-6c04-48a2-9188-cbbbaa49788f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:47.245239 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b762858b-6c04-48a2-9188-cbbbaa49788f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:47.246010 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b762858b-6c04-48a2-9188-cbbbaa49788f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:47.246443 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b762858b-6c04-48a2-9188-cbbbaa49788f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:47.321452 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-bc8c58b5-7892-44b6-bc43-4d22539c723a req-4fc78f2a-f14c-4484-9974-be87157de48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dd536e-b54a-4af0-8010-b44bca82fbe9", "name": "network-vif-unplugged", "status": "completed", "tag": "a7bf0759-e717-4ad7-bf72-ba59bd3a1455"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:47.329751 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-bc8c58b5-7892-44b6-bc43-4d22539c723a req-4fc78f2a-f14c-4484-9974-be87157de48a service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:47.330194 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-bc8c58b5-7892-44b6-bc43-4d22539c723a req-4fc78f2a-f14c-4484-9974-be87157de48a service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:47.342078 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-bc8c58b5-7892-44b6-bc43-4d22539c723a req-4fc78f2a-f14c-4484-9974-be87157de48a service nova] Creating event network-vif-unplugged:a7bf0759-e717-4ad7-bf72-ba59bd3a1455 for instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 on hv-cinder-79760 May 27 09:48:47.347052 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-bc8c58b5-7892-44b6-bc43-4d22539c723a req-4fc78f2a-f14c-4484-9974-be87157de48a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029256 May 27 09:48:47.348013 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 470/946] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:48:47.373933 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b762858b-6c04-48a2-9188-cbbbaa49788f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:47.382393 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b762858b-6c04-48a2-9188-cbbbaa49788f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:47.383931 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b762858b-6c04-48a2-9188-cbbbaa49788f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:47.385083 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b762858b-6c04-48a2-9188-cbbbaa49788f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1742 microversion: 2.20 time: 0.152151 May 27 09:48:47.385640 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 477/947] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:47 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:47.523399 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a2d90693-d6c0-4df7-8f99-2215ad5e0f53 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:47.524152 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a2d90693-d6c0-4df7-8f99-2215ad5e0f53 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:47.530406 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2d90693-d6c0-4df7-8f99-2215ad5e0f53 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:47.530857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2d90693-d6c0-4df7-8f99-2215ad5e0f53 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:47.531640 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2d90693-d6c0-4df7-8f99-2215ad5e0f53 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:47.532101 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a2d90693-d6c0-4df7-8f99-2215ad5e0f53 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:47.664516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a2d90693-d6c0-4df7-8f99-2215ad5e0f53 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:47.671936 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a2d90693-d6c0-4df7-8f99-2215ad5e0f53 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.152757 May 27 09:48:47.672503 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 471/948] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:47 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:48.403990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bbca0860-98c8-4b9e-a2ac-c8662d124b83 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:48.404511 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bbca0860-98c8-4b9e-a2ac-c8662d124b83 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:48.411561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bbca0860-98c8-4b9e-a2ac-c8662d124b83 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:48.412037 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bbca0860-98c8-4b9e-a2ac-c8662d124b83 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:48.412802 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bbca0860-98c8-4b9e-a2ac-c8662d124b83 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:48.413236 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bbca0860-98c8-4b9e-a2ac-c8662d124b83 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:48.537501 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bbca0860-98c8-4b9e-a2ac-c8662d124b83 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:48.545307 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bbca0860-98c8-4b9e-a2ac-c8662d124b83 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:48.546812 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bbca0860-98c8-4b9e-a2ac-c8662d124b83 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:48.548000 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bbca0860-98c8-4b9e-a2ac-c8662d124b83 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1742 microversion: 2.20 time: 0.148046 May 27 09:48:48.548545 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 478/949] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:48 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1742 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:48.688889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ff423047-c0e1-4fa3-85fc-a16cabb6b25e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:48.689418 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ff423047-c0e1-4fa3-85fc-a16cabb6b25e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:48.696385 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff423047-c0e1-4fa3-85fc-a16cabb6b25e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:48.696835 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff423047-c0e1-4fa3-85fc-a16cabb6b25e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:48.697596 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff423047-c0e1-4fa3-85fc-a16cabb6b25e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:48.698034 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ff423047-c0e1-4fa3-85fc-a16cabb6b25e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:48.826344 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ff423047-c0e1-4fa3-85fc-a16cabb6b25e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:48.834311 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ff423047-c0e1-4fa3-85fc-a16cabb6b25e tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.149392 May 27 09:48:48.834882 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 472/950] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:48 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:49.565960 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-75f52efe-d9e2-43d3-b081-4678fdd4f1cb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:49.566710 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-75f52efe-d9e2-43d3-b081-4678fdd4f1cb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:49.573460 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75f52efe-d9e2-43d3-b081-4678fdd4f1cb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:49.573919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75f52efe-d9e2-43d3-b081-4678fdd4f1cb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:49.574775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75f52efe-d9e2-43d3-b081-4678fdd4f1cb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:49.575228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75f52efe-d9e2-43d3-b081-4678fdd4f1cb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:49.713540 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-75f52efe-d9e2-43d3-b081-4678fdd4f1cb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:49.723056 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-75f52efe-d9e2-43d3-b081-4678fdd4f1cb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:49.725241 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-75f52efe-d9e2-43d3-b081-4678fdd4f1cb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:49.726653 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-75f52efe-d9e2-43d3-b081-4678fdd4f1cb tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1737 microversion: 2.20 time: 0.164587 May 27 09:48:49.736489 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 479/951] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:49 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:49.852093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e7e11433-0dd3-4551-beac-903186f9cba8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:49.852730 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e7e11433-0dd3-4551-beac-903186f9cba8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:49.859118 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e7e11433-0dd3-4551-beac-903186f9cba8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:49.859601 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e7e11433-0dd3-4551-beac-903186f9cba8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:49.860365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e7e11433-0dd3-4551-beac-903186f9cba8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:49.860799 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e7e11433-0dd3-4551-beac-903186f9cba8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:50.005079 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e7e11433-0dd3-4551-beac-903186f9cba8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:50.012937 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e7e11433-0dd3-4551-beac-903186f9cba8 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.164635 May 27 09:48:50.023267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 473/952] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:49 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:50.747166 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6f845ef0-6b1a-4869-9172-fcd590d200d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:50.747874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6f845ef0-6b1a-4869-9172-fcd590d200d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:50.755990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f845ef0-6b1a-4869-9172-fcd590d200d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:50.756433 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f845ef0-6b1a-4869-9172-fcd590d200d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:50.757196 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f845ef0-6b1a-4869-9172-fcd590d200d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:50.757625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f845ef0-6b1a-4869-9172-fcd590d200d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:50.954205 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6f845ef0-6b1a-4869-9172-fcd590d200d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:50.962296 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6f845ef0-6b1a-4869-9172-fcd590d200d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:50.964117 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6f845ef0-6b1a-4869-9172-fcd590d200d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:50.965289 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6f845ef0-6b1a-4869-9172-fcd590d200d5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1737 microversion: 2.20 time: 0.222195 May 27 09:48:50.965853 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 480/953] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:50 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:51.030001 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-07082376-a7b0-4791-8e4d-50abe1fbe8a4 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:51.030619 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-07082376-a7b0-4791-8e4d-50abe1fbe8a4 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:51.042681 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-07082376-a7b0-4791-8e4d-50abe1fbe8a4 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:51.043134 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-07082376-a7b0-4791-8e4d-50abe1fbe8a4 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:51.043951 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-07082376-a7b0-4791-8e4d-50abe1fbe8a4 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:51.044391 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-07082376-a7b0-4791-8e4d-50abe1fbe8a4 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:51.273258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-07082376-a7b0-4791-8e4d-50abe1fbe8a4 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:51.281438 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-07082376-a7b0-4791-8e4d-50abe1fbe8a4 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.254887 May 27 09:48:51.282565 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 474/954] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:51 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:51.985012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1df946bb-b674-4447-ae26-5db2f4fd7ebf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:51.986287 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1df946bb-b674-4447-ae26-5db2f4fd7ebf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:51.993281 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1df946bb-b674-4447-ae26-5db2f4fd7ebf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:51.993735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1df946bb-b674-4447-ae26-5db2f4fd7ebf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:51.994516 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1df946bb-b674-4447-ae26-5db2f4fd7ebf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:51.994956 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1df946bb-b674-4447-ae26-5db2f4fd7ebf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:52.133224 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1df946bb-b674-4447-ae26-5db2f4fd7ebf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:52.141453 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1df946bb-b674-4447-ae26-5db2f4fd7ebf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:52.143851 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1df946bb-b674-4447-ae26-5db2f4fd7ebf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:52.145040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1df946bb-b674-4447-ae26-5db2f4fd7ebf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1737 microversion: 2.20 time: 0.164099 May 27 09:48:52.145898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 481/955] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:51 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:52.300983 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1d0ce3e4-077f-4c06-a3cb-ef7d19e48540 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:52.301595 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1d0ce3e4-077f-4c06-a3cb-ef7d19e48540 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:52.308885 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d0ce3e4-077f-4c06-a3cb-ef7d19e48540 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:52.309727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d0ce3e4-077f-4c06-a3cb-ef7d19e48540 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:52.310503 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d0ce3e4-077f-4c06-a3cb-ef7d19e48540 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:52.311019 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1d0ce3e4-077f-4c06-a3cb-ef7d19e48540 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:52.453285 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1d0ce3e4-077f-4c06-a3cb-ef7d19e48540 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:52.462042 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1d0ce3e4-077f-4c06-a3cb-ef7d19e48540 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.164990 May 27 09:48:52.463151 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 475/956] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:52 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:53.163444 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e154ba6e-dad2-4b49-9595-270f287f1e2e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:53.163976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e154ba6e-dad2-4b49-9595-270f287f1e2e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:53.170464 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e154ba6e-dad2-4b49-9595-270f287f1e2e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:53.170910 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e154ba6e-dad2-4b49-9595-270f287f1e2e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:53.171711 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e154ba6e-dad2-4b49-9595-270f287f1e2e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:53.172139 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e154ba6e-dad2-4b49-9595-270f287f1e2e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:53.316642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e154ba6e-dad2-4b49-9595-270f287f1e2e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:53.327645 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e154ba6e-dad2-4b49-9595-270f287f1e2e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:53.329186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e154ba6e-dad2-4b49-9595-270f287f1e2e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:53.330352 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e154ba6e-dad2-4b49-9595-270f287f1e2e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1737 microversion: 2.20 time: 0.170966 May 27 09:48:53.330945 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 482/957] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:53 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:48:53.479918 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c62507a9-f737-4993-8f27-cf635b2a715d tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:53.480455 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c62507a9-f737-4993-8f27-cf635b2a715d tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:53.487655 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c62507a9-f737-4993-8f27-cf635b2a715d tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:53.488107 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c62507a9-f737-4993-8f27-cf635b2a715d tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:53.488879 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c62507a9-f737-4993-8f27-cf635b2a715d tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:53.489319 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c62507a9-f737-4993-8f27-cf635b2a715d tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:53.630506 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c62507a9-f737-4993-8f27-cf635b2a715d tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:53.639872 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c62507a9-f737-4993-8f27-cf635b2a715d tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.163737 May 27 09:48:53.640790 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 476/958] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:53 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:54.351410 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-109f0a68-9c59-4330-bad3-be7aeccf4e74 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:54.352029 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-109f0a68-9c59-4330-bad3-be7aeccf4e74 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:54.364958 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-109f0a68-9c59-4330-bad3-be7aeccf4e74 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:54.365408 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-109f0a68-9c59-4330-bad3-be7aeccf4e74 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:54.366189 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-109f0a68-9c59-4330-bad3-be7aeccf4e74 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:54.366626 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-109f0a68-9c59-4330-bad3-be7aeccf4e74 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:54.513178 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-109f0a68-9c59-4330-bad3-be7aeccf4e74 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:54.521977 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-109f0a68-9c59-4330-bad3-be7aeccf4e74 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:54.523609 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-109f0a68-9c59-4330-bad3-be7aeccf4e74 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:54.525140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-109f0a68-9c59-4330-bad3-be7aeccf4e74 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1737 microversion: 2.20 time: 0.179422 May 27 09:48:54.525820 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 483/959] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:54 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:54.657928 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b81aa5b8-cc37-4d7d-b62d-1d86881e648f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:54.659163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b81aa5b8-cc37-4d7d-b62d-1d86881e648f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:54.666229 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b81aa5b8-cc37-4d7d-b62d-1d86881e648f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:54.666960 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b81aa5b8-cc37-4d7d-b62d-1d86881e648f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:54.667971 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b81aa5b8-cc37-4d7d-b62d-1d86881e648f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:54.668608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b81aa5b8-cc37-4d7d-b62d-1d86881e648f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:54.812098 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b81aa5b8-cc37-4d7d-b62d-1d86881e648f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:54.820500 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b81aa5b8-cc37-4d7d-b62d-1d86881e648f tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.166680 May 27 09:48:54.821569 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 477/960] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:54 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:55.544773 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ea1ed2cd-231e-4838-a9c2-f44acd1d73fc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:55.545479 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ea1ed2cd-231e-4838-a9c2-f44acd1d73fc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:55.547948 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=53 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:55.553952 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ea1ed2cd-231e-4838-a9c2-f44acd1d73fc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:55.554613 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ea1ed2cd-231e-4838-a9c2-f44acd1d73fc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:55.555406 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ea1ed2cd-231e-4838-a9c2-f44acd1d73fc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:55.556590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ea1ed2cd-231e-4838-a9c2-f44acd1d73fc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:55.708528 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ea1ed2cd-231e-4838-a9c2-f44acd1d73fc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:55.717087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ea1ed2cd-231e-4838-a9c2-f44acd1d73fc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:55.718852 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ea1ed2cd-231e-4838-a9c2-f44acd1d73fc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:55.720141 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ea1ed2cd-231e-4838-a9c2-f44acd1d73fc tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1737 microversion: 2.20 time: 0.179826 May 27 09:48:55.728251 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 484/961] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:55 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:55.837962 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-13e2c0b1-9c5b-4d57-b97c-7243beaae53a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:55.838578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-13e2c0b1-9c5b-4d57-b97c-7243beaae53a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:55.841516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=59 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:55.846978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-13e2c0b1-9c5b-4d57-b97c-7243beaae53a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:55.847475 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-13e2c0b1-9c5b-4d57-b97c-7243beaae53a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:55.848255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-13e2c0b1-9c5b-4d57-b97c-7243beaae53a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:55.848699 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-13e2c0b1-9c5b-4d57-b97c-7243beaae53a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:55.997168 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-13e2c0b1-9c5b-4d57-b97c-7243beaae53a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:56.006848 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-13e2c0b1-9c5b-4d57-b97c-7243beaae53a tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.172605 May 27 09:48:56.007642 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 478/962] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:55 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:56.743684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-6f7f8f5c-ed35-4996-9ca2-2563406aa813 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:56.744996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-6f7f8f5c-ed35-4996-9ca2-2563406aa813 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:56.765198 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f7f8f5c-ed35-4996-9ca2-2563406aa813 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:56.765649 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f7f8f5c-ed35-4996-9ca2-2563406aa813 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:56.766443 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f7f8f5c-ed35-4996-9ca2-2563406aa813 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:56.766883 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-6f7f8f5c-ed35-4996-9ca2-2563406aa813 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:56.917964 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6f7f8f5c-ed35-4996-9ca2-2563406aa813 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:56.927954 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6f7f8f5c-ed35-4996-9ca2-2563406aa813 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:56.932660 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-6f7f8f5c-ed35-4996-9ca2-2563406aa813 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:56.934083 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-6f7f8f5c-ed35-4996-9ca2-2563406aa813 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1737 microversion: 2.20 time: 0.198261 May 27 09:48:56.941218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 485/963] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:56 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:57.024186 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b9cb29f1-416b-4916-a199-7796b67c34b1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:57.025516 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b9cb29f1-416b-4916-a199-7796b67c34b1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:57.036068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b9cb29f1-416b-4916-a199-7796b67c34b1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:57.037364 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b9cb29f1-416b-4916-a199-7796b67c34b1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:57.038711 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b9cb29f1-416b-4916-a199-7796b67c34b1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:57.039411 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b9cb29f1-416b-4916-a199-7796b67c34b1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:57.203440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b9cb29f1-416b-4916-a199-7796b67c34b1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:57.211375 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b9cb29f1-416b-4916-a199-7796b67c34b1 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.190949 May 27 09:48:57.212059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 479/964] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:57 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:57.450961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-651f1124-fc9d-4bef-87f3-bb57f2318667 req-fc2fb6c8-24ae-45f4-823b-20d7e11cfb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dd536e-b54a-4af0-8010-b44bca82fbe9", "name": "network-vif-plugged", "status": "completed", "tag": "a7bf0759-e717-4ad7-bf72-ba59bd3a1455"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:57.462476 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-651f1124-fc9d-4bef-87f3-bb57f2318667 req-fc2fb6c8-24ae-45f4-823b-20d7e11cfb2b service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:57.463239 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-651f1124-fc9d-4bef-87f3-bb57f2318667 req-fc2fb6c8-24ae-45f4-823b-20d7e11cfb2b service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:57.491880 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-651f1124-fc9d-4bef-87f3-bb57f2318667 req-fc2fb6c8-24ae-45f4-823b-20d7e11cfb2b service nova] Creating event network-vif-plugged:a7bf0759-e717-4ad7-bf72-ba59bd3a1455 for instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 on hv-cinder-79760 May 27 09:48:57.500982 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-651f1124-fc9d-4bef-87f3-bb57f2318667 req-fc2fb6c8-24ae-45f4-823b-20d7e11cfb2b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053586 May 27 09:48:57.502098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 486/965] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:48:57.966272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f358adda-bd00-46a1-bf17-3971e7dd35b0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:57.968468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f358adda-bd00-46a1-bf17-3971e7dd35b0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:57.977506 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f358adda-bd00-46a1-bf17-3971e7dd35b0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:57.978159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f358adda-bd00-46a1-bf17-3971e7dd35b0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:57.979440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f358adda-bd00-46a1-bf17-3971e7dd35b0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:57.980033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f358adda-bd00-46a1-bf17-3971e7dd35b0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:58.147533 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f358adda-bd00-46a1-bf17-3971e7dd35b0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:58.159906 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f358adda-bd00-46a1-bf17-3971e7dd35b0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:58.161598 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f358adda-bd00-46a1-bf17-3971e7dd35b0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:58.162902 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f358adda-bd00-46a1-bf17-3971e7dd35b0 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1737 microversion: 2.20 time: 0.209801 May 27 09:48:58.163669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 480/966] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:57 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:58.231766 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-72be222f-ebc8-4601-a1d9-660cebd70dd3 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:58.233473 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-72be222f-ebc8-4601-a1d9-660cebd70dd3 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:58.240329 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72be222f-ebc8-4601-a1d9-660cebd70dd3 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:58.240785 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72be222f-ebc8-4601-a1d9-660cebd70dd3 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:58.241599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72be222f-ebc8-4601-a1d9-660cebd70dd3 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:58.242066 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72be222f-ebc8-4601-a1d9-660cebd70dd3 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:58.412969 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-72be222f-ebc8-4601-a1d9-660cebd70dd3 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:58.421684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-72be222f-ebc8-4601-a1d9-660cebd70dd3 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.196448 May 27 09:48:58.423311 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 487/967] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:58 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:59.181508 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0fd5291a-61f5-404d-8c18-3e658243c6c2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:59.182124 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0fd5291a-61f5-404d-8c18-3e658243c6c2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:59.188628 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0fd5291a-61f5-404d-8c18-3e658243c6c2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:59.189082 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0fd5291a-61f5-404d-8c18-3e658243c6c2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:59.189928 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0fd5291a-61f5-404d-8c18-3e658243c6c2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:59.190925 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0fd5291a-61f5-404d-8c18-3e658243c6c2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:59.208825 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:59.334223 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0fd5291a-61f5-404d-8c18-3e658243c6c2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:59.343476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0fd5291a-61f5-404d-8c18-3e658243c6c2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:59.345295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0fd5291a-61f5-404d-8c18-3e658243c6c2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:59.347251 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0fd5291a-61f5-404d-8c18-3e658243c6c2 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1737 microversion: 2.20 time: 0.169663 May 27 09:48:59.348187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 481/968] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:48:59 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:48:59.438203 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e8ece4eb-8dea-408c-a235-74c1c2dc9194 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:59.439501 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e8ece4eb-8dea-408c-a235-74c1c2dc9194 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:59.447158 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e8ece4eb-8dea-408c-a235-74c1c2dc9194 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:59.447970 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e8ece4eb-8dea-408c-a235-74c1c2dc9194 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:59.448988 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e8ece4eb-8dea-408c-a235-74c1c2dc9194 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:59.449647 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e8ece4eb-8dea-408c-a235-74c1c2dc9194 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:59.600422 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e8ece4eb-8dea-408c-a235-74c1c2dc9194 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:59.608395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e8ece4eb-8dea-408c-a235-74c1c2dc9194 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1576 microversion: 2.1 time: 0.174200 May 27 09:48:59.609166 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 488/969] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:48:59 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:00.366702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fbb4c6b1-346d-4510-a0f5-490599f6467e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:00.367338 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-fbb4c6b1-346d-4510-a0f5-490599f6467e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:00.373805 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fbb4c6b1-346d-4510-a0f5-490599f6467e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:00.374293 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fbb4c6b1-346d-4510-a0f5-490599f6467e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:00.375069 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fbb4c6b1-346d-4510-a0f5-490599f6467e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:00.375540 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fbb4c6b1-346d-4510-a0f5-490599f6467e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:00.507101 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fbb4c6b1-346d-4510-a0f5-490599f6467e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:00.515905 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fbb4c6b1-346d-4510-a0f5-490599f6467e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:00.517414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fbb4c6b1-346d-4510-a0f5-490599f6467e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:00.518574 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fbb4c6b1-346d-4510-a0f5-490599f6467e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1737 microversion: 2.20 time: 0.155818 May 27 09:49:00.519145 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 482/970] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:00 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:00.625913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fa7e0c86-d498-4d89-8240-9e8f62e7b2d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:00.626455 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fa7e0c86-d498-4d89-8240-9e8f62e7b2d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:00.633610 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fa7e0c86-d498-4d89-8240-9e8f62e7b2d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:00.634066 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fa7e0c86-d498-4d89-8240-9e8f62e7b2d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:00.634834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fa7e0c86-d498-4d89-8240-9e8f62e7b2d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:00.635285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fa7e0c86-d498-4d89-8240-9e8f62e7b2d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:00.767744 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fa7e0c86-d498-4d89-8240-9e8f62e7b2d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:00.775933 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fa7e0c86-d498-4d89-8240-9e8f62e7b2d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1563 microversion: 2.1 time: 0.153908 May 27 09:49:00.776514 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 489/971] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:49:00 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:01.536860 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4e3e1487-2963-4a6e-ab3c-bdf58596631c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:01.537505 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4e3e1487-2963-4a6e-ab3c-bdf58596631c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:01.544284 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4e3e1487-2963-4a6e-ab3c-bdf58596631c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:01.544742 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4e3e1487-2963-4a6e-ab3c-bdf58596631c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:01.545524 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4e3e1487-2963-4a6e-ab3c-bdf58596631c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:01.545963 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4e3e1487-2963-4a6e-ab3c-bdf58596631c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:01.735119 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4e3e1487-2963-4a6e-ab3c-bdf58596631c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:01.744493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4e3e1487-2963-4a6e-ab3c-bdf58596631c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:01.746481 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4e3e1487-2963-4a6e-ab3c-bdf58596631c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:01.747686 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4e3e1487-2963-4a6e-ab3c-bdf58596631c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1719 microversion: 2.20 time: 0.214724 May 27 09:49:01.748254 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 483/972] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:01 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1719 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:02.765923 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f2c5d83b-182f-43d0-be17-e3363dc7c45b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:02.766588 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f2c5d83b-182f-43d0-be17-e3363dc7c45b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:02.773536 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2c5d83b-182f-43d0-be17-e3363dc7c45b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:02.773985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2c5d83b-182f-43d0-be17-e3363dc7c45b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:02.774738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2c5d83b-182f-43d0-be17-e3363dc7c45b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:02.775173 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f2c5d83b-182f-43d0-be17-e3363dc7c45b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:02.779245 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=100 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:02.919874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f2c5d83b-182f-43d0-be17-e3363dc7c45b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:02.927688 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f2c5d83b-182f-43d0-be17-e3363dc7c45b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:02.929185 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f2c5d83b-182f-43d0-be17-e3363dc7c45b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:02.930332 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f2c5d83b-182f-43d0-be17-e3363dc7c45b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1719 microversion: 2.20 time: 0.168311 May 27 09:49:02.930910 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 490/973] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:02 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:03.421678 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-8f7db037-9f74-4447-b094-d6a4f4358773 req-becf5472-6927-4158-8106-8a9fe1c59b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330ed71b-ab48-42b7-b46e-98be00f7343e", "name": "network-vif-unplugged", "status": "completed", "tag": "9011439f-1b54-4948-87ab-dd7cd4f186e5"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:03.432054 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-8f7db037-9f74-4447-b094-d6a4f4358773 req-becf5472-6927-4158-8106-8a9fe1c59b59 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:03.432616 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-8f7db037-9f74-4447-b094-d6a4f4358773 req-becf5472-6927-4158-8106-8a9fe1c59b59 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:03.444494 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-8f7db037-9f74-4447-b094-d6a4f4358773 req-becf5472-6927-4158-8106-8a9fe1c59b59 service nova] Creating event network-vif-unplugged:9011439f-1b54-4948-87ab-dd7cd4f186e5 for instance 330ed71b-ab48-42b7-b46e-98be00f7343e on hv-cinder-79760 May 27 09:49:03.449817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-8f7db037-9f74-4447-b094-d6a4f4358773 req-becf5472-6927-4158-8106-8a9fe1c59b59 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032581 May 27 09:49:03.450660 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 484/974] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:03.947895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c6a61ae8-50b5-4607-a473-69223a9bd93c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:03.948537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c6a61ae8-50b5-4607-a473-69223a9bd93c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:03.955057 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6a61ae8-50b5-4607-a473-69223a9bd93c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:03.955539 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6a61ae8-50b5-4607-a473-69223a9bd93c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:03.956310 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6a61ae8-50b5-4607-a473-69223a9bd93c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:03.957325 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c6a61ae8-50b5-4607-a473-69223a9bd93c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.170468 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c6a61ae8-50b5-4607-a473-69223a9bd93c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:04.179735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c6a61ae8-50b5-4607-a473-69223a9bd93c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:04.181254 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c6a61ae8-50b5-4607-a473-69223a9bd93c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:04.182412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c6a61ae8-50b5-4607-a473-69223a9bd93c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1722 microversion: 2.20 time: 0.238427 May 27 09:49:04.183043 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 491/975] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:03 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:04.205209 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-392d0cf2-7174-49d5-b68f-a6b8f2b8481f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "906226ea-f17a-429a-96ed-c4a4dc897ca4"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:04.206379 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-392d0cf2-7174-49d5-b68f-a6b8f2b8481f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:04.212579 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-392d0cf2-7174-49d5-b68f-a6b8f2b8481f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:04.213035 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-392d0cf2-7174-49d5-b68f-a6b8f2b8481f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.214134 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-392d0cf2-7174-49d5-b68f-a6b8f2b8481f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:04.214542 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-392d0cf2-7174-49d5-b68f-a6b8f2b8481f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.485394 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-392d0cf2-7174-49d5-b68f-a6b8f2b8481f tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.285349 May 27 09:49:04.486028 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 485/976] 10.222.0.41 () {62 vars in 1363 bytes} [Fri May 27 09:49:04 2022] POST /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 09:49:04.597605 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e5563600-46cd-467f-a141-49becc553f51 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:04.598104 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e5563600-46cd-467f-a141-49becc553f51 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:04.604064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5563600-46cd-467f-a141-49becc553f51 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:04.604519 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5563600-46cd-467f-a141-49becc553f51 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.605287 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5563600-46cd-467f-a141-49becc553f51 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:04.605729 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e5563600-46cd-467f-a141-49becc553f51 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.833348 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e5563600-46cd-467f-a141-49becc553f51 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "DELETE /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/os-volume_attachments/906226ea-f17a-429a-96ed-c4a4dc897ca4" status: 202 len: 0 microversion: 2.20 time: 0.240157 May 27 09:49:04.833936 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 492/977] 10.222.0.41 () {60 vars in 1456 bytes} [Fri May 27 09:49:04 2022] DELETE /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/os-volume_attachments/906226ea-f17a-429a-96ed-c4a4dc897ca4 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 09:49:04.891333 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dc172d86-ca9e-4107-a037-aae9bd7beedf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:04.891899 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dc172d86-ca9e-4107-a037-aae9bd7beedf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:04.898431 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dc172d86-ca9e-4107-a037-aae9bd7beedf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:04.898875 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dc172d86-ca9e-4107-a037-aae9bd7beedf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.899667 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dc172d86-ca9e-4107-a037-aae9bd7beedf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:04.900098 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dc172d86-ca9e-4107-a037-aae9bd7beedf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.976532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dc172d86-ca9e-4107-a037-aae9bd7beedf tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "POST /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/action" status: 202 len: 0 microversion: 2.20 time: 0.089331 May 27 09:49:04.977244 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 486/978] 10.222.0.41 () {62 vars in 1318 bytes} [Fri May 27 09:49:04 2022] POST /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 09:49:04.985247 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b906fce8-2086-4715-bfa4-f32d86621b2c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:04.985947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b906fce8-2086-4715-bfa4-f32d86621b2c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:04.992455 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b906fce8-2086-4715-bfa4-f32d86621b2c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:04.992906 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b906fce8-2086-4715-bfa4-f32d86621b2c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.993678 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b906fce8-2086-4715-bfa4-f32d86621b2c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:04.994186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b906fce8-2086-4715-bfa4-f32d86621b2c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:05.142131 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b906fce8-2086-4715-bfa4-f32d86621b2c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:05.150641 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b906fce8-2086-4715-bfa4-f32d86621b2c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:05.152190 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b906fce8-2086-4715-bfa4-f32d86621b2c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:05.153393 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b906fce8-2086-4715-bfa4-f32d86621b2c tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1670 microversion: 2.20 time: 0.172189 May 27 09:49:05.153947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 493/979] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:04 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:06.307224 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f4d149eb-9e21-4cd5-a262-0cb55c1447af tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:06.307872 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f4d149eb-9e21-4cd5-a262-0cb55c1447af tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:06.313854 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4d149eb-9e21-4cd5-a262-0cb55c1447af tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:06.314300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4d149eb-9e21-4cd5-a262-0cb55c1447af tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:06.315063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4d149eb-9e21-4cd5-a262-0cb55c1447af tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:06.315523 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f4d149eb-9e21-4cd5-a262-0cb55c1447af tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:06.516295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f4d149eb-9e21-4cd5-a262-0cb55c1447af tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:06.524842 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f4d149eb-9e21-4cd5-a262-0cb55c1447af tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:06.526385 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f4d149eb-9e21-4cd5-a262-0cb55c1447af tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:06.527584 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f4d149eb-9e21-4cd5-a262-0cb55c1447af tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.358680 May 27 09:49:06.528344 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 487/980] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:06 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:07.546066 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4cb77c37-e3c1-4557-a2a8-f01500ebf4da tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:07.546812 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4cb77c37-e3c1-4557-a2a8-f01500ebf4da tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:07.554175 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4cb77c37-e3c1-4557-a2a8-f01500ebf4da tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:07.554630 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4cb77c37-e3c1-4557-a2a8-f01500ebf4da tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:07.555447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4cb77c37-e3c1-4557-a2a8-f01500ebf4da tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:07.555887 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4cb77c37-e3c1-4557-a2a8-f01500ebf4da tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:07.689579 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4cb77c37-e3c1-4557-a2a8-f01500ebf4da tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:07.697616 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4cb77c37-e3c1-4557-a2a8-f01500ebf4da tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:07.699178 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-4cb77c37-e3c1-4557-a2a8-f01500ebf4da tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:07.700382 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4cb77c37-e3c1-4557-a2a8-f01500ebf4da tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.158338 May 27 09:49:07.700956 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 494/981] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:07 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:08.719493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8c3aead3-a139-4cbe-b3ae-cd615fd8ffc1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:08.720309 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8c3aead3-a139-4cbe-b3ae-cd615fd8ffc1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:08.726780 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c3aead3-a139-4cbe-b3ae-cd615fd8ffc1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:08.727234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c3aead3-a139-4cbe-b3ae-cd615fd8ffc1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:08.728093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c3aead3-a139-4cbe-b3ae-cd615fd8ffc1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:08.728532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c3aead3-a139-4cbe-b3ae-cd615fd8ffc1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:08.868557 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8c3aead3-a139-4cbe-b3ae-cd615fd8ffc1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:08.879318 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8c3aead3-a139-4cbe-b3ae-cd615fd8ffc1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:08.880837 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-8c3aead3-a139-4cbe-b3ae-cd615fd8ffc1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:08.882015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8c3aead3-a139-4cbe-b3ae-cd615fd8ffc1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.166589 May 27 09:49:08.882579 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 488/982] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:08 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:09.901008 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-856994ca-c6ac-47ba-aaad-6a1624205947 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:09.901652 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-856994ca-c6ac-47ba-aaad-6a1624205947 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:09.908859 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-856994ca-c6ac-47ba-aaad-6a1624205947 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:09.909313 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-856994ca-c6ac-47ba-aaad-6a1624205947 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:09.910095 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-856994ca-c6ac-47ba-aaad-6a1624205947 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:09.910534 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-856994ca-c6ac-47ba-aaad-6a1624205947 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:10.044657 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-856994ca-c6ac-47ba-aaad-6a1624205947 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:10.053027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-856994ca-c6ac-47ba-aaad-6a1624205947 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:10.054520 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-856994ca-c6ac-47ba-aaad-6a1624205947 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:10.055696 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-856994ca-c6ac-47ba-aaad-6a1624205947 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.158684 May 27 09:49:10.056251 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 495/983] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:09 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:11.074675 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-601ce6e8-a939-4a85-b916-e0aaf851813d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:11.075331 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-601ce6e8-a939-4a85-b916-e0aaf851813d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:11.082496 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-601ce6e8-a939-4a85-b916-e0aaf851813d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:11.082941 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-601ce6e8-a939-4a85-b916-e0aaf851813d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:11.083734 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-601ce6e8-a939-4a85-b916-e0aaf851813d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:11.084168 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-601ce6e8-a939-4a85-b916-e0aaf851813d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:11.232664 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-601ce6e8-a939-4a85-b916-e0aaf851813d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:11.241191 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-601ce6e8-a939-4a85-b916-e0aaf851813d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:11.242692 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-601ce6e8-a939-4a85-b916-e0aaf851813d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:11.243908 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-601ce6e8-a939-4a85-b916-e0aaf851813d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.173280 May 27 09:49:11.244689 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 489/984] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:11 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:12.262079 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-68a720bd-b306-4e20-abe1-6d20ecfecad4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:12.262724 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-68a720bd-b306-4e20-abe1-6d20ecfecad4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:12.269718 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68a720bd-b306-4e20-abe1-6d20ecfecad4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:12.270156 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68a720bd-b306-4e20-abe1-6d20ecfecad4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:12.270916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68a720bd-b306-4e20-abe1-6d20ecfecad4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:12.271387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68a720bd-b306-4e20-abe1-6d20ecfecad4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:12.416297 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-68a720bd-b306-4e20-abe1-6d20ecfecad4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:12.424795 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-68a720bd-b306-4e20-abe1-6d20ecfecad4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:12.426860 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-68a720bd-b306-4e20-abe1-6d20ecfecad4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:12.428050 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-68a720bd-b306-4e20-abe1-6d20ecfecad4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.169845 May 27 09:49:12.428744 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 496/985] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:12 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:13.446634 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a18d9b29-5b52-4dfb-913c-8a18f9eb2ab3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:13.447309 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a18d9b29-5b52-4dfb-913c-8a18f9eb2ab3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:13.453890 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a18d9b29-5b52-4dfb-913c-8a18f9eb2ab3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:13.454332 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a18d9b29-5b52-4dfb-913c-8a18f9eb2ab3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:13.455096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a18d9b29-5b52-4dfb-913c-8a18f9eb2ab3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:13.455562 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a18d9b29-5b52-4dfb-913c-8a18f9eb2ab3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:13.596860 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a18d9b29-5b52-4dfb-913c-8a18f9eb2ab3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:13.604937 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a18d9b29-5b52-4dfb-913c-8a18f9eb2ab3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:13.606437 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a18d9b29-5b52-4dfb-913c-8a18f9eb2ab3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:13.607698 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a18d9b29-5b52-4dfb-913c-8a18f9eb2ab3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.164964 May 27 09:49:13.608478 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 490/986] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:13 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:49:14.625902 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c4c2091f-8c74-4b6e-95fc-3fa74b9717a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:14.626508 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c4c2091f-8c74-4b6e-95fc-3fa74b9717a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:14.633693 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c4c2091f-8c74-4b6e-95fc-3fa74b9717a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:14.634141 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c4c2091f-8c74-4b6e-95fc-3fa74b9717a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:14.634911 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c4c2091f-8c74-4b6e-95fc-3fa74b9717a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:14.635372 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c4c2091f-8c74-4b6e-95fc-3fa74b9717a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:14.771158 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c4c2091f-8c74-4b6e-95fc-3fa74b9717a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:14.781113 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c4c2091f-8c74-4b6e-95fc-3fa74b9717a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:14.784071 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c4c2091f-8c74-4b6e-95fc-3fa74b9717a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:14.786934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c4c2091f-8c74-4b6e-95fc-3fa74b9717a3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.164015 May 27 09:49:14.787558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 497/987] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:14 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:15.806352 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9339eaeb-2726-4477-b084-7b029e9d5360 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:15.807291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9339eaeb-2726-4477-b084-7b029e9d5360 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:15.814217 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9339eaeb-2726-4477-b084-7b029e9d5360 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:15.814661 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9339eaeb-2726-4477-b084-7b029e9d5360 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:15.815475 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9339eaeb-2726-4477-b084-7b029e9d5360 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:15.815915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9339eaeb-2726-4477-b084-7b029e9d5360 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:15.954110 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9339eaeb-2726-4477-b084-7b029e9d5360 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:15.962268 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9339eaeb-2726-4477-b084-7b029e9d5360 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:15.964122 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9339eaeb-2726-4477-b084-7b029e9d5360 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:15.965296 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9339eaeb-2726-4477-b084-7b029e9d5360 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.163525 May 27 09:49:15.966095 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 491/988] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:15 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:16.984705 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-75bd0d61-6724-4fac-bccd-4bb46b36ea0b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:16.985603 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-75bd0d61-6724-4fac-bccd-4bb46b36ea0b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:16.992414 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75bd0d61-6724-4fac-bccd-4bb46b36ea0b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:16.992864 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75bd0d61-6724-4fac-bccd-4bb46b36ea0b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:16.993636 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75bd0d61-6724-4fac-bccd-4bb46b36ea0b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:16.994072 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-75bd0d61-6724-4fac-bccd-4bb46b36ea0b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:17.132058 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-75bd0d61-6724-4fac-bccd-4bb46b36ea0b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:17.140494 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-75bd0d61-6724-4fac-bccd-4bb46b36ea0b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:17.141989 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-75bd0d61-6724-4fac-bccd-4bb46b36ea0b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:17.143151 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-75bd0d61-6724-4fac-bccd-4bb46b36ea0b tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.163140 May 27 09:49:17.143740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 498/989] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:16 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:18.162054 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-913570ef-dbda-4d76-99b9-9046ad27d594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:18.162664 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-913570ef-dbda-4d76-99b9-9046ad27d594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:18.169485 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-913570ef-dbda-4d76-99b9-9046ad27d594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:18.169937 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-913570ef-dbda-4d76-99b9-9046ad27d594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:18.170717 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-913570ef-dbda-4d76-99b9-9046ad27d594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:18.171159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-913570ef-dbda-4d76-99b9-9046ad27d594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:18.299341 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-913570ef-dbda-4d76-99b9-9046ad27d594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:18.307720 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-913570ef-dbda-4d76-99b9-9046ad27d594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:18.309225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-913570ef-dbda-4d76-99b9-9046ad27d594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:18.310379 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-913570ef-dbda-4d76-99b9-9046ad27d594 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.152722 May 27 09:49:18.310939 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 492/990] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:18 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:19.328774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e1cd6cd2-b813-401a-8ab7-a98a188a562d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:19.329390 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e1cd6cd2-b813-401a-8ab7-a98a188a562d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:19.336510 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e1cd6cd2-b813-401a-8ab7-a98a188a562d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:19.336963 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e1cd6cd2-b813-401a-8ab7-a98a188a562d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:19.337733 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e1cd6cd2-b813-401a-8ab7-a98a188a562d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:19.338173 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e1cd6cd2-b813-401a-8ab7-a98a188a562d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:19.468580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e1cd6cd2-b813-401a-8ab7-a98a188a562d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:19.476465 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e1cd6cd2-b813-401a-8ab7-a98a188a562d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:19.478014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e1cd6cd2-b813-401a-8ab7-a98a188a562d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:19.479171 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e1cd6cd2-b813-401a-8ab7-a98a188a562d tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.154328 May 27 09:49:19.479765 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 499/991] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:19 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:20.497451 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f12d350e-781c-468d-896d-e4660bc51930 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:20.498051 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f12d350e-781c-468d-896d-e4660bc51930 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:20.505050 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f12d350e-781c-468d-896d-e4660bc51930 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:20.505473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f12d350e-781c-468d-896d-e4660bc51930 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:20.506251 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f12d350e-781c-468d-896d-e4660bc51930 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:20.506668 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f12d350e-781c-468d-896d-e4660bc51930 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:20.635989 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f12d350e-781c-468d-896d-e4660bc51930 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:20.643697 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f12d350e-781c-468d-896d-e4660bc51930 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:20.645198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f12d350e-781c-468d-896d-e4660bc51930 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:20.646339 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f12d350e-781c-468d-896d-e4660bc51930 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.152876 May 27 09:49:20.646908 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 493/992] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:20 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:21.339396 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e73efc87-d966-412d-8ad5-dde62b4a39d9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:21.339895 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e73efc87-d966-412d-8ad5-dde62b4a39d9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:21.345754 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e73efc87-d966-412d-8ad5-dde62b4a39d9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:21.346200 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e73efc87-d966-412d-8ad5-dde62b4a39d9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:21.346948 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e73efc87-d966-412d-8ad5-dde62b4a39d9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:21.348014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e73efc87-d966-412d-8ad5-dde62b4a39d9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:21.370101 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e73efc87-d966-412d-8ad5-dde62b4a39d9 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/ips" status: 200 len: 145 microversion: 2.1 time: 0.163253 May 27 09:49:21.370643 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 500/993] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 09:49:21 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/ips => generated 145 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:21.664676 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fc11df69-3f4f-41ac-ade0-543bd77af407 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:21.665291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-fc11df69-3f4f-41ac-ade0-543bd77af407 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:21.671709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc11df69-3f4f-41ac-ade0-543bd77af407 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:21.672163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc11df69-3f4f-41ac-ade0-543bd77af407 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:21.673012 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc11df69-3f4f-41ac-ade0-543bd77af407 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:21.673459 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc11df69-3f4f-41ac-ade0-543bd77af407 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:21.800907 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fc11df69-3f4f-41ac-ade0-543bd77af407 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:21.808761 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fc11df69-3f4f-41ac-ade0-543bd77af407 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:21.810251 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fc11df69-3f4f-41ac-ade0-543bd77af407 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:21.811423 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fc11df69-3f4f-41ac-ade0-543bd77af407 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.150681 May 27 09:49:21.811985 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 494/994] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:21 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:22.677042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-da69ed29-6b89-42fa-91b9-8c1d6f197c8a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ece2e266-340d-4dfb-adb3-13e7f149d9b7"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:22.678182 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-da69ed29-6b89-42fa-91b9-8c1d6f197c8a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:22.684706 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da69ed29-6b89-42fa-91b9-8c1d6f197c8a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:22.685154 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da69ed29-6b89-42fa-91b9-8c1d6f197c8a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:22.685918 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da69ed29-6b89-42fa-91b9-8c1d6f197c8a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:22.686352 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-da69ed29-6b89-42fa-91b9-8c1d6f197c8a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:22.829860 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-29a5ade8-0700-478d-abd6-4efde48d4385 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:22.830476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-29a5ade8-0700-478d-abd6-4efde48d4385 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:22.837362 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-29a5ade8-0700-478d-abd6-4efde48d4385 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:22.837814 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-29a5ade8-0700-478d-abd6-4efde48d4385 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:22.838572 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-29a5ade8-0700-478d-abd6-4efde48d4385 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:22.839264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-29a5ade8-0700-478d-abd6-4efde48d4385 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:22.843187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:22.969824 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-29a5ade8-0700-478d-abd6-4efde48d4385 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:22.978304 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-29a5ade8-0700-478d-abd6-4efde48d4385 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:22.979824 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-29a5ade8-0700-478d-abd6-4efde48d4385 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:22.980969 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-29a5ade8-0700-478d-abd6-4efde48d4385 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.154981 May 27 09:49:22.981533 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 495/995] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:22 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:49:23.200910 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-da69ed29-6b89-42fa-91b9-8c1d6f197c8a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.528292 May 27 09:49:23.201508 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 501/996] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:49:22 2022] POST /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:23.998807 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a39adae9-cdc6-46c5-a347-0479f308aeff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:23.999468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a39adae9-cdc6-46c5-a347-0479f308aeff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:24.006535 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a39adae9-cdc6-46c5-a347-0479f308aeff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:24.006987 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a39adae9-cdc6-46c5-a347-0479f308aeff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:24.007796 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a39adae9-cdc6-46c5-a347-0479f308aeff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:24.008234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a39adae9-cdc6-46c5-a347-0479f308aeff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:24.134603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a39adae9-cdc6-46c5-a347-0479f308aeff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:24.142551 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a39adae9-cdc6-46c5-a347-0479f308aeff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:24.144719 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a39adae9-cdc6-46c5-a347-0479f308aeff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:24.145883 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a39adae9-cdc6-46c5-a347-0479f308aeff tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.150967 May 27 09:49:24.146447 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 496/997] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:23 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:25.165647 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-23c46bdf-9ff3-4c31-980c-edb5262574b5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:25.166378 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-23c46bdf-9ff3-4c31-980c-edb5262574b5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:25.172593 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-23c46bdf-9ff3-4c31-980c-edb5262574b5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:25.173043 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-23c46bdf-9ff3-4c31-980c-edb5262574b5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:25.173807 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-23c46bdf-9ff3-4c31-980c-edb5262574b5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:25.174243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-23c46bdf-9ff3-4c31-980c-edb5262574b5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:25.309905 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-23c46bdf-9ff3-4c31-980c-edb5262574b5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:25.317771 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-23c46bdf-9ff3-4c31-980c-edb5262574b5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:25.319264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-23c46bdf-9ff3-4c31-980c-edb5262574b5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:25.320438 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-23c46bdf-9ff3-4c31-980c-edb5262574b5 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.159520 May 27 09:49:25.320990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 502/998] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:25 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:25.613746 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-e74be319-9910-4a2c-8e41-3e8c7d04d64c req-3c0a03c5-9c81-467a-a31d-9712a6994cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330ed71b-ab48-42b7-b46e-98be00f7343e", "name": "network-vif-plugged", "status": "completed", "tag": "9011439f-1b54-4948-87ab-dd7cd4f186e5"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:25.623235 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-e74be319-9910-4a2c-8e41-3e8c7d04d64c req-3c0a03c5-9c81-467a-a31d-9712a6994cd2 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:25.623707 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-e74be319-9910-4a2c-8e41-3e8c7d04d64c req-3c0a03c5-9c81-467a-a31d-9712a6994cd2 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:25.635258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-e74be319-9910-4a2c-8e41-3e8c7d04d64c req-3c0a03c5-9c81-467a-a31d-9712a6994cd2 service nova] Creating event network-vif-plugged:9011439f-1b54-4948-87ab-dd7cd4f186e5 for instance 330ed71b-ab48-42b7-b46e-98be00f7343e on hv-cinder-79760 May 27 09:49:25.640175 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-e74be319-9910-4a2c-8e41-3e8c7d04d64c req-3c0a03c5-9c81-467a-a31d-9712a6994cd2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030072 May 27 09:49:25.640763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 497/999] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:26.338345 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9554f8a4-28ca-4056-a5e7-8069db911ba6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:26.339211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9554f8a4-28ca-4056-a5e7-8069db911ba6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:26.341582 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=38 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:26.346817 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9554f8a4-28ca-4056-a5e7-8069db911ba6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:26.347804 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9554f8a4-28ca-4056-a5e7-8069db911ba6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:26.348573 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9554f8a4-28ca-4056-a5e7-8069db911ba6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:26.349006 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9554f8a4-28ca-4056-a5e7-8069db911ba6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:26.364199 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:26.478937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9554f8a4-28ca-4056-a5e7-8069db911ba6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:26.486830 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9554f8a4-28ca-4056-a5e7-8069db911ba6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:26.488934 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9554f8a4-28ca-4056-a5e7-8069db911ba6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:26.490079 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9554f8a4-28ca-4056-a5e7-8069db911ba6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.155614 May 27 09:49:26.490629 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 503/1000] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:26 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:27.509379 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0efa4a22-9c6b-450c-a222-d8cf514150c3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:27.510096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0efa4a22-9c6b-450c-a222-d8cf514150c3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:27.512539 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=42 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:27.518131 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0efa4a22-9c6b-450c-a222-d8cf514150c3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:27.518576 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0efa4a22-9c6b-450c-a222-d8cf514150c3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:27.520280 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0efa4a22-9c6b-450c-a222-d8cf514150c3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:27.520722 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0efa4a22-9c6b-450c-a222-d8cf514150c3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:27.663086 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0efa4a22-9c6b-450c-a222-d8cf514150c3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:27.671553 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0efa4a22-9c6b-450c-a222-d8cf514150c3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:27.672994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-0efa4a22-9c6b-450c-a222-d8cf514150c3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:27.674204 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0efa4a22-9c6b-450c-a222-d8cf514150c3 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1728 microversion: 2.20 time: 0.169071 May 27 09:49:27.675138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 498/1001] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:27 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:28.693025 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d29b9c55-fd20-4eac-b2af-e5cb49ca0a8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:28.693621 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d29b9c55-fd20-4eac-b2af-e5cb49ca0a8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:28.700018 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d29b9c55-fd20-4eac-b2af-e5cb49ca0a8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:28.700465 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d29b9c55-fd20-4eac-b2af-e5cb49ca0a8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:28.701220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d29b9c55-fd20-4eac-b2af-e5cb49ca0a8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:28.701647 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d29b9c55-fd20-4eac-b2af-e5cb49ca0a8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:28.827948 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d29b9c55-fd20-4eac-b2af-e5cb49ca0a8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:28.835732 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d29b9c55-fd20-4eac-b2af-e5cb49ca0a8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:28.837235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d29b9c55-fd20-4eac-b2af-e5cb49ca0a8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:28.838376 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d29b9c55-fd20-4eac-b2af-e5cb49ca0a8e tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1715 microversion: 2.20 time: 0.149753 May 27 09:49:28.839193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 504/1002] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:49:28 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:49:30.697302 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5ddf22e4-b7f4-44cc-9cb7-ca621128f2b6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:30.698237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5ddf22e4-b7f4-44cc-9cb7-ca621128f2b6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:30.704781 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5ddf22e4-b7f4-44cc-9cb7-ca621128f2b6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:30.705235 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5ddf22e4-b7f4-44cc-9cb7-ca621128f2b6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:30.705999 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5ddf22e4-b7f4-44cc-9cb7-ca621128f2b6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:30.706497 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5ddf22e4-b7f4-44cc-9cb7-ca621128f2b6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:30.737600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5ddf22e4-b7f4-44cc-9cb7-ca621128f2b6 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 May 27 09:49:30.738707 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 499/1003] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:49:30 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:30.748429 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2dd7bbea-8af2-4a1e-8164-247699d12ad2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:30.748937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2dd7bbea-8af2-4a1e-8164-247699d12ad2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:30.755439 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2dd7bbea-8af2-4a1e-8164-247699d12ad2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:30.755882 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2dd7bbea-8af2-4a1e-8164-247699d12ad2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:30.756637 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2dd7bbea-8af2-4a1e-8164-247699d12ad2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:30.757066 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2dd7bbea-8af2-4a1e-8164-247699d12ad2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:30.784229 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2dd7bbea-8af2-4a1e-8164-247699d12ad2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments/ece2e266-340d-4dfb-adb3-13e7f149d9b7" status: 200 len: 194 microversion: 2.1 time: 0.039712 May 27 09:49:30.785296 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 505/1004] 10.222.0.41 () {58 vars in 1412 bytes} [Fri May 27 09:49:30 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments/ece2e266-340d-4dfb-adb3-13e7f149d9b7 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:32.107080 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a0631cb3-ab88-43dd-b019-b41841e5bea3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24effe10-ea80-42a8-b13c-bebaf719d246"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:32.108213 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a0631cb3-ab88-43dd-b019-b41841e5bea3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:32.114616 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a0631cb3-ab88-43dd-b019-b41841e5bea3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:32.115063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a0631cb3-ab88-43dd-b019-b41841e5bea3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:32.115855 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a0631cb3-ab88-43dd-b019-b41841e5bea3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:32.116293 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a0631cb3-ab88-43dd-b019-b41841e5bea3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:32.367788 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a0631cb3-ab88-43dd-b019-b41841e5bea3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "POST /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264413 May 27 09:49:32.368441 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 500/1005] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:49:32 2022] POST /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:39.846598 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2d4750f3-c0f1-4719-8e5e-2a2cbd464115 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:39.847657 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2d4750f3-c0f1-4719-8e5e-2a2cbd464115 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:39.854248 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d4750f3-c0f1-4719-8e5e-2a2cbd464115 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:39.854732 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d4750f3-c0f1-4719-8e5e-2a2cbd464115 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:39.855534 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d4750f3-c0f1-4719-8e5e-2a2cbd464115 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:39.855976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d4750f3-c0f1-4719-8e5e-2a2cbd464115 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:39.886027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2d4750f3-c0f1-4719-8e5e-2a2cbd464115 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043232 May 27 09:49:39.886508 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 506/1006] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:49:39 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:39.993048 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d9f9aba4-0b57-4223-90ea-0909fa50d9ea tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:39.993629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d9f9aba4-0b57-4223-90ea-0909fa50d9ea tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:39.999783 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d9f9aba4-0b57-4223-90ea-0909fa50d9ea tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:40.000231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d9f9aba4-0b57-4223-90ea-0909fa50d9ea tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:40.000998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d9f9aba4-0b57-4223-90ea-0909fa50d9ea tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:40.001434 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d9f9aba4-0b57-4223-90ea-0909fa50d9ea tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:40.029364 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d9f9aba4-0b57-4223-90ea-0909fa50d9ea tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments/ece2e266-340d-4dfb-adb3-13e7f149d9b7" status: 200 len: 194 microversion: 2.1 time: 0.041694 May 27 09:49:40.029933 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 501/1007] 10.222.0.41 () {58 vars in 1412 bytes} [Fri May 27 09:49:39 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments/ece2e266-340d-4dfb-adb3-13e7f149d9b7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:40.039702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-09368fd5-8461-4856-8c2e-76661f984202 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:40.040188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-09368fd5-8461-4856-8c2e-76661f984202 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:40.046330 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-09368fd5-8461-4856-8c2e-76661f984202 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:40.046772 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-09368fd5-8461-4856-8c2e-76661f984202 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:40.047567 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-09368fd5-8461-4856-8c2e-76661f984202 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:40.047996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-09368fd5-8461-4856-8c2e-76661f984202 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:40.126523 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-09368fd5-8461-4856-8c2e-76661f984202 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lazy-loading 'services' on Instance uuid 69ce3d24-302e-4c81-ae42-b0670172d8d6 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:49:40.197260 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-09368fd5-8461-4856-8c2e-76661f984202 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments/ece2e266-340d-4dfb-adb3-13e7f149d9b7" status: 202 len: 0 microversion: 2.1 time: 0.161429 May 27 09:49:40.197843 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 507/1008] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:49:40 2022] DELETE /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments/ece2e266-340d-4dfb-adb3-13e7f149d9b7 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:49:42.359967 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c4cc062c-f84d-479f-8a61-d02ac710558a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:42.360611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c4cc062c-f84d-479f-8a61-d02ac710558a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:42.367653 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c4cc062c-f84d-479f-8a61-d02ac710558a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:42.368106 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c4cc062c-f84d-479f-8a61-d02ac710558a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:42.368864 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c4cc062c-f84d-479f-8a61-d02ac710558a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:42.369303 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c4cc062c-f84d-479f-8a61-d02ac710558a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:42.397050 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c4cc062c-f84d-479f-8a61-d02ac710558a tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments/24effe10-ea80-42a8-b13c-bebaf719d246" status: 200 len: 194 microversion: 2.1 time: 0.041060 May 27 09:49:42.397626 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 502/1009] 10.222.0.41 () {58 vars in 1412 bytes} [Fri May 27 09:49:42 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments/24effe10-ea80-42a8-b13c-bebaf719d246 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:42.407757 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bdd476cc-4496-4d25-a0eb-f3c37bbb6cec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:42.408332 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bdd476cc-4496-4d25-a0eb-f3c37bbb6cec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:42.414999 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdd476cc-4496-4d25-a0eb-f3c37bbb6cec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:42.415488 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdd476cc-4496-4d25-a0eb-f3c37bbb6cec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:42.416243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdd476cc-4496-4d25-a0eb-f3c37bbb6cec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:42.416674 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bdd476cc-4496-4d25-a0eb-f3c37bbb6cec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:42.497013 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-bdd476cc-4496-4d25-a0eb-f3c37bbb6cec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lazy-loading 'services' on Instance uuid 69ce3d24-302e-4c81-ae42-b0670172d8d6 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:49:42.565598 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bdd476cc-4496-4d25-a0eb-f3c37bbb6cec tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments/24effe10-ea80-42a8-b13c-bebaf719d246" status: 202 len: 0 microversion: 2.1 time: 0.161887 May 27 09:49:42.566216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 508/1010] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:49:42 2022] DELETE /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments/24effe10-ea80-42a8-b13c-bebaf719d246 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:49:43.727133 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f07586bb-1e8f-4a07-81c1-eabb8d442096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:43.728098 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f07586bb-1e8f-4a07-81c1-eabb8d442096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:43.734413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f07586bb-1e8f-4a07-81c1-eabb8d442096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:43.734863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f07586bb-1e8f-4a07-81c1-eabb8d442096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:43.735648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f07586bb-1e8f-4a07-81c1-eabb8d442096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:43.736087 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f07586bb-1e8f-4a07-81c1-eabb8d442096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:43.764493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f07586bb-1e8f-4a07-81c1-eabb8d442096 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041252 May 27 09:49:43.765041 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 503/1011] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:49:43 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:49:43.868879 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fb6a3cdd-b15c-4900-bb8c-8bd26f4edfda tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:43.869943 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fb6a3cdd-b15c-4900-bb8c-8bd26f4edfda tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:43.876481 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb6a3cdd-b15c-4900-bb8c-8bd26f4edfda tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:43.876946 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb6a3cdd-b15c-4900-bb8c-8bd26f4edfda tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:43.878050 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb6a3cdd-b15c-4900-bb8c-8bd26f4edfda tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:43.878707 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fb6a3cdd-b15c-4900-bb8c-8bd26f4edfda tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:43.908713 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fb6a3cdd-b15c-4900-bb8c-8bd26f4edfda tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045137 May 27 09:49:43.909268 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 509/1012] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:49:43 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:49:43.965536 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a66123ac-3917-4f78-9806-4648fef6fc51 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:43.966035 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a66123ac-3917-4f78-9806-4648fef6fc51 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:43.971929 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a66123ac-3917-4f78-9806-4648fef6fc51 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:43.972404 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a66123ac-3917-4f78-9806-4648fef6fc51 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:43.973166 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a66123ac-3917-4f78-9806-4648fef6fc51 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:43.973604 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a66123ac-3917-4f78-9806-4648fef6fc51 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:43.997559 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a66123ac-3917-4f78-9806-4648fef6fc51 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:49:44.077718 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a66123ac-3917-4f78-9806-4648fef6fc51 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 204 len: 0 microversion: 2.1 time: 0.115897 May 27 09:49:44.078315 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 504/1013] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:49:43 2022] DELETE /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 09:49:44.087133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-329468a2-0e88-4aec-8383-53c0bcef6bc1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:44.087985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-329468a2-0e88-4aec-8383-53c0bcef6bc1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:44.095527 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-329468a2-0e88-4aec-8383-53c0bcef6bc1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:44.096067 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-329468a2-0e88-4aec-8383-53c0bcef6bc1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:44.096911 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-329468a2-0e88-4aec-8383-53c0bcef6bc1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:44.097350 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-329468a2-0e88-4aec-8383-53c0bcef6bc1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:44.229132 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-329468a2-0e88-4aec-8383-53c0bcef6bc1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:44.236593 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-329468a2-0e88-4aec-8383-53c0bcef6bc1 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1671 microversion: 2.1 time: 0.154083 May 27 09:49:44.237156 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 510/1014] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:49:44 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:45.254668 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-67abb3a2-25a3-472b-9231-7c7209a516e5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:45.255958 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-67abb3a2-25a3-472b-9231-7c7209a516e5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:45.262381 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-67abb3a2-25a3-472b-9231-7c7209a516e5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:45.262832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-67abb3a2-25a3-472b-9231-7c7209a516e5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:45.263662 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-67abb3a2-25a3-472b-9231-7c7209a516e5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:45.264659 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-67abb3a2-25a3-472b-9231-7c7209a516e5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:45.391663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-67abb3a2-25a3-472b-9231-7c7209a516e5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:45.399124 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-67abb3a2-25a3-472b-9231-7c7209a516e5 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1671 microversion: 2.1 time: 0.148696 May 27 09:49:45.399717 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 505/1015] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:49:45 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:46.416284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-325910d8-e212-46d5-b7ad-a16015eed185 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:46.416801 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-325910d8-e212-46d5-b7ad-a16015eed185 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:46.423223 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-325910d8-e212-46d5-b7ad-a16015eed185 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:46.423708 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-325910d8-e212-46d5-b7ad-a16015eed185 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:46.424472 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-325910d8-e212-46d5-b7ad-a16015eed185 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:46.424904 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-325910d8-e212-46d5-b7ad-a16015eed185 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:46.622377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-325910d8-e212-46d5-b7ad-a16015eed185 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:46.629796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-325910d8-e212-46d5-b7ad-a16015eed185 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1671 microversion: 2.1 time: 0.217523 May 27 09:49:46.631215 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 511/1016] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:49:46 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1671 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:47.393016 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-ec52a312-1dcd-4811-a1f0-ee29f03be7d1 req-5b183bbb-0022-44d5-beff-db7a5220c861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ce3d24-302e-4c81-ae42-b0670172d8d6", "name": "network-vif-deleted", "tag": "dc3fff52-3e58-4032-878e-443fd16673dd"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:47.403085 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-ec52a312-1dcd-4811-a1f0-ee29f03be7d1 req-5b183bbb-0022-44d5-beff-db7a5220c861 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:47.403828 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-ec52a312-1dcd-4811-a1f0-ee29f03be7d1 req-5b183bbb-0022-44d5-beff-db7a5220c861 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:47.419410 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-ec52a312-1dcd-4811-a1f0-ee29f03be7d1 req-5b183bbb-0022-44d5-beff-db7a5220c861 service nova] Creating event network-vif-deleted:dc3fff52-3e58-4032-878e-443fd16673dd for instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 on hv-cinder-79760 May 27 09:49:47.426116 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-ec52a312-1dcd-4811-a1f0-ee29f03be7d1 req-5b183bbb-0022-44d5-beff-db7a5220c861 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096567 May 27 09:49:47.427096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 506/1017] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:47.648115 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:47.648736 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:47.655257 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:47.655685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:47.656462 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:47.656901 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:47.690917 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:47.691406 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:47.691856 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lazy-loading 'fault' on Instance uuid 69ce3d24-302e-4c81-ae42-b0670172d8d6 {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:49:47.732802 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2463c2327e364ca996768e3eb6ef6316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06332dc6f29b4d01b047104d93bbef0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:47.740907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-43652e87-a319-4509-a9d2-e3c4715ddce2 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 200 len: 1326 microversion: 2.1 time: 0.096734 May 27 09:49:47.741479 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 512/1018] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:49:47 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:48.758107 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0fefec1b-eb27-491e-af7c-381bc8e3e257 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:48.758813 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0fefec1b-eb27-491e-af7c-381bc8e3e257 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:48.765031 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0fefec1b-eb27-491e-af7c-381bc8e3e257 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:48.765485 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0fefec1b-eb27-491e-af7c-381bc8e3e257 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:48.766256 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0fefec1b-eb27-491e-af7c-381bc8e3e257 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:48.766700 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0fefec1b-eb27-491e-af7c-381bc8e3e257 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:48.779673 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-0fefec1b-eb27-491e-af7c-381bc8e3e257 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] HTTP exception thrown: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0fefec1b-eb27-491e-af7c-381bc8e3e257 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Request method failure captured: May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 HTTP/1.1 May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJw9oOm2RiM8wUbsXVgubOOLdR_nWsLqhV_M3N5RHT0uVzprERX4dGeAoJkjRdRsnlntvTXqNp-zRysr9sefmnmpC68GOuDR4uRL5JXsL4vW_6Ggreon_S3ASGx7Dft7e7OOpNlBezyMnnUYPq00ExsB2lqn2wDVWKoTeldY0v2zkOw May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:49:48.781255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_06332dc6f29b4d01b047104d93bbef0f"}]}] May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 2463c2327e364ca996768e3eb6ef6316 May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:48.782710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '69ce3d24-302e-4c81-ae42-b0670172d8d6'} May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:48.783622 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:48.785126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:48.787055 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0fefec1b-eb27-491e-af7c-381bc8e3e257 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Returning 404 to user: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:48.787055 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0fefec1b-eb27-491e-af7c-381bc8e3e257 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 404 len: 111 microversion: 2.1 time: 0.029185 May 27 09:49:48.787055 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 507/1019] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:49:48 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:49:48.791878 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d01b5fdb-51e8-416b-9725-54092f461689 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '.version_select at 0x7f188c280670>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:48.810023 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d01b5fdb-51e8-416b-9725-54092f461689 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757181806" status: 202 len: 0 microversion: 2.1 time: 0.021935 May 27 09:49:48.810577 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 513/1020] 10.222.0.41 () {58 vars in 1217 bytes} [Fri May 27 09:49:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757181806 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 09:49:51.918619 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d9b20317-5aa6-4462-a9af-4eb6183e3775 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:51.919121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d9b20317-5aa6-4462-a9af-4eb6183e3775 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:51.925537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d9b20317-5aa6-4462-a9af-4eb6183e3775 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:51.925994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d9b20317-5aa6-4462-a9af-4eb6183e3775 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:51.926759 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d9b20317-5aa6-4462-a9af-4eb6183e3775 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:51.927200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d9b20317-5aa6-4462-a9af-4eb6183e3775 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:51.943041 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-d9b20317-5aa6-4462-a9af-4eb6183e3775 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] HTTP exception thrown: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d9b20317-5aa6-4462-a9af-4eb6183e3775 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Request method failure captured: May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 HTTP/1.1 May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJw9oOm2RiM8wUbsXVgubOOLdR_nWsLqhV_M3N5RHT0uVzprERX4dGeAoJkjRdRsnlntvTXqNp-zRysr9sefmnmpC68GOuDR4uRL5JXsL4vW_6Ggreon_S3ASGx7Dft7e7OOpNlBezyMnnUYPq00ExsB2lqn2wDVWKoTeldY0v2zkOw May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:49:51.944589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_06332dc6f29b4d01b047104d93bbef0f"}]}] May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 2463c2327e364ca996768e3eb6ef6316 May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:51.946109 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '69ce3d24-302e-4c81-ae42-b0670172d8d6'} May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:51.947039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:51.948568 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:51.950316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d9b20317-5aa6-4462-a9af-4eb6183e3775 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Returning 404 to user: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:51.950316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d9b20317-5aa6-4462-a9af-4eb6183e3775 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 404 len: 111 microversion: 2.1 time: 0.031159 May 27 09:49:51.950316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 508/1021] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:49:51 2022] DELETE /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:49:51.954953 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7f634910-d104-4ad4-b538-db9574b0ff8e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:51.955661 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7f634910-d104-4ad4-b538-db9574b0ff8e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: 69ce3d24-302e-4c81-ae42-b0670172d8d6] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:51.962363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7f634910-d104-4ad4-b538-db9574b0ff8e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:51.962812 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7f634910-d104-4ad4-b538-db9574b0ff8e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:51.963621 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7f634910-d104-4ad4-b538-db9574b0ff8e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:51.964427 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7f634910-d104-4ad4-b538-db9574b0ff8e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:51.978523 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-7f634910-d104-4ad4-b538-db9574b0ff8e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] HTTP exception thrown: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7f634910-d104-4ad4-b538-db9574b0ff8e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Request method failure captured: May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 HTTP/1.1 May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJw9oOm2RiM8wUbsXVgubOOLdR_nWsLqhV_M3N5RHT0uVzprERX4dGeAoJkjRdRsnlntvTXqNp-zRysr9sefmnmpC68GOuDR4uRL5JXsL4vW_6Ggreon_S3ASGx7Dft7e7OOpNlBezyMnnUYPq00ExsB2lqn2wDVWKoTeldY0v2zkOw May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:49:51.980181 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_06332dc6f29b4d01b047104d93bbef0f"}]}] May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 2463c2327e364ca996768e3eb6ef6316 May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:51.981731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '69ce3d24-302e-4c81-ae42-b0670172d8d6'} May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:51.982532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. May 27 09:49:51.984046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:51.985374 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7f634910-d104-4ad4-b538-db9574b0ff8e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Returning 404 to user: Instance 69ce3d24-302e-4c81-ae42-b0670172d8d6 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:51.985374 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7f634910-d104-4ad4-b538-db9574b0ff8e tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6" status: 404 len: 111 microversion: 2.1 time: 0.031033 May 27 09:49:51.985374 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 514/1022] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:49:51 2022] GET /compute/v2.1/servers/69ce3d24-302e-4c81-ae42-b0670172d8d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:49:53.117217 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c6178833-8216-4a02-a2fa-a837bf581fd3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:53.117720 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c6178833-8216-4a02-a2fa-a837bf581fd3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:53.124237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c6178833-8216-4a02-a2fa-a837bf581fd3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:53.124713 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c6178833-8216-4a02-a2fa-a837bf581fd3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:53.125467 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c6178833-8216-4a02-a2fa-a837bf581fd3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:53.125902 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c6178833-8216-4a02-a2fa-a837bf581fd3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:53.128520 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:53.141588 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-c6178833-8216-4a02-a2fa-a837bf581fd3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] HTTP exception thrown: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c6178833-8216-4a02-a2fa-a837bf581fd3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Request method failure captured: May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f HTTP/1.1 May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJw9oOm2RiM8wUbsXVgubOOLdR_nWsLqhV_M3N5RHT0uVzprERX4dGeAoJkjRdRsnlntvTXqNp-zRysr9sefmnmpC68GOuDR4uRL5JXsL4vW_6Ggreon_S3ASGx7Dft7e7OOpNlBezyMnnUYPq00ExsB2lqn2wDVWKoTeldY0v2zkOw May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:49:53.143234 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_06332dc6f29b4d01b047104d93bbef0f"}]}] May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 2463c2327e364ca996768e3eb6ef6316 May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:49:53.144873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'd5c817de-8115-43f6-9a05-6366318ea29f'} May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:53.145708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:49:53.146944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:53.148171 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c6178833-8216-4a02-a2fa-a837bf581fd3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Returning 404 to user: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:53.148171 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c6178833-8216-4a02-a2fa-a837bf581fd3 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 404 len: 111 microversion: 2.1 time: 0.031852 May 27 09:49:53.148171 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 509/1023] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:49:53 2022] DELETE /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:49:53.152848 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2cc0693b-6bc1-4d9a-a215-672b39786378 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:53.153461 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2cc0693b-6bc1-4d9a-a215-672b39786378 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] [instance: d5c817de-8115-43f6-9a05-6366318ea29f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:53.159994 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2cc0693b-6bc1-4d9a-a215-672b39786378 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:53.160443 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2cc0693b-6bc1-4d9a-a215-672b39786378 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:53.161235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2cc0693b-6bc1-4d9a-a215-672b39786378 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:53.162186 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2cc0693b-6bc1-4d9a-a215-672b39786378 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:53.175615 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-2cc0693b-6bc1-4d9a-a215-672b39786378 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] HTTP exception thrown: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2cc0693b-6bc1-4d9a-a215-672b39786378 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Request method failure captured: May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f HTTP/1.1 May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJw9oOm2RiM8wUbsXVgubOOLdR_nWsLqhV_M3N5RHT0uVzprERX4dGeAoJkjRdRsnlntvTXqNp-zRysr9sefmnmpC68GOuDR4uRL5JXsL4vW_6Ggreon_S3ASGx7Dft7e7OOpNlBezyMnnUYPq00ExsB2lqn2wDVWKoTeldY0v2zkOw May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:49:53.177098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/06332dc6f29b4d01b047104d93bbef0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_06332dc6f29b4d01b047104d93bbef0f"}]}] May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 06332dc6f29b4d01b047104d93bbef0f May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1260786785 May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 2463c2327e364ca996768e3eb6ef6316 May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeTestJSON-1260786785-project May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:49:53.179161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': 'd5c817de-8115-43f6-9a05-6366318ea29f'} May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:53.179992 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. May 27 09:49:53.181341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:53.187937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2cc0693b-6bc1-4d9a-a215-672b39786378 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] Returning 404 to user: Instance d5c817de-8115-43f6-9a05-6366318ea29f could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:53.187937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2cc0693b-6bc1-4d9a-a215-672b39786378 tempest-AttachVolumeTestJSON-1260786785 tempest-AttachVolumeTestJSON-1260786785-project] 10.222.0.41 "GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f" status: 404 len: 111 microversion: 2.1 time: 0.030015 May 27 09:49:53.187937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 515/1024] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:49:53 2022] GET /compute/v2.1/servers/d5c817de-8115-43f6-9a05-6366318ea29f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:49:55.123995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e21f080c-9a23-4b0b-aa31-0bf69c9e7bdc tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:55.124545 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e21f080c-9a23-4b0b-aa31-0bf69c9e7bdc tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:55.131578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e21f080c-9a23-4b0b-aa31-0bf69c9e7bdc tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:55.132703 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e21f080c-9a23-4b0b-aa31-0bf69c9e7bdc tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:55.133553 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e21f080c-9a23-4b0b-aa31-0bf69c9e7bdc tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:55.134152 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e21f080c-9a23-4b0b-aa31-0bf69c9e7bdc tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:55.158740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e21f080c-9a23-4b0b-aa31-0bf69c9e7bdc tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/ips" status: 200 len: 148 microversion: 2.1 time: 0.039128 May 27 09:49:55.171542 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 510/1025] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 09:49:55 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/ips => generated 148 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:57.577300 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-050378f2-4401-45ff-bffe-3285ee742fa3 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Action: 'create', calling method: .version_select at 0x7f188c313790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-177287908", "metadata": {"Type": "work"}}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-050378f2-4401-45ff-bffe-3285ee742fa3 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Request method failure captured: May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 121 May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ7F4XLq_SAV7l8gHwOERKxcCUt9zl9SCV7AAQyMxwf1M9FbFG0RENNTIY9QzeoT_lVSNEholQcXdcjF0TQUJmXo7Z4ncZgRv3ykrtvAMuX7g-5hrPsVd65tvz5OQsXJucNBXdPtZgcuwOmtzW_px9Ka-FJtZCx6cOVW5sdd03jNtVA May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:49:57.594342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6be9af66b7048778fd5b823a1535450"}]}] May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 426d1d2e2b7245afbd688b174059dce5 May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-177287908", "metadata": {"Type": "work"}}} May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: May 27 09:49:57.595985 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-177287908', 'metadata': {'Type': 'work'}}}} May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise error May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi '#$%' May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:57.597015 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 09:49:57.598659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 09:49:57.599975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 09:49:57.599975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:49:57.599975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-050378f2-4401-45ff-bffe-3285ee742fa3 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:57.599975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-050378f2-4401-45ff-bffe-3285ee742fa3 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132223 May 27 09:49:57.601314 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 516/1026] 10.222.0.41 () {60 vars in 1155 bytes} [Fri May 27 09:49:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 09:49:57.605898 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-eb2036e4-5522-42b4-9126-26b6f3313cfb tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Action: 'create', calling method: .version_select at 0x7f1890bc9700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-903172491", "metadata": {"Type": "work"}}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:57.607235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-311d5ede-7d9c-41ad-9560-866d433bd38d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaa5742f-04d6-4309-84c5-153a2a70f221"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:57.608318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-311d5ede-7d9c-41ad-9560-866d433bd38d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-eb2036e4-5522-42b4-9126-26b6f3313cfb tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Request method failure captured: May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 119 May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ7F4XLq_SAV7l8gHwOERKxcCUt9zl9SCV7AAQyMxwf1M9FbFG0RENNTIY9QzeoT_lVSNEholQcXdcjF0TQUJmXo7Z4ncZgRv3ykrtvAMuX7g-5hrPsVd65tvz5OQsXJucNBXdPtZgcuwOmtzW_px9Ka-FJtZCx6cOVW5sdd03jNtVA May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:49:57.609065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6be9af66b7048778fd5b823a1535450"}]}] May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 426d1d2e2b7245afbd688b174059dce5 May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-903172491", "metadata": {"Type": "work"}}} May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: May 27 09:49:57.610693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-903172491', 'metadata': {'Type': 'work'}}}} May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise error May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi '0' May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:57.611772 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 09:49:57.613074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 09:49:57.614245 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 09:49:57.614245 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.614245 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-eb2036e4-5522-42b4-9126-26b6f3313cfb tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:57.614245 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-eb2036e4-5522-42b4-9126-26b6f3313cfb tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008236 May 27 09:49:57.614245 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 511/1027] 10.222.0.41 () {60 vars in 1155 bytes} [Fri May 27 09:49:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 09:49:57.614731 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:57.616364 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-311d5ede-7d9c-41ad-9560-866d433bd38d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:57.617322 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-311d5ede-7d9c-41ad-9560-866d433bd38d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:57.618106 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-311d5ede-7d9c-41ad-9560-866d433bd38d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:57.618545 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-311d5ede-7d9c-41ad-9560-866d433bd38d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:57.621089 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dba469fe-71be-480f-abee-0307d0b276f0 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Action: 'create', calling method: .version_select at 0x7f188c2e1dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1970653524", "metadata": {"Type": "work"}}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:57.622096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dba469fe-71be-480f-abee-0307d0b276f0 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Request method failure captured: May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 119 May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ7F4XLq_SAV7l8gHwOERKxcCUt9zl9SCV7AAQyMxwf1M9FbFG0RENNTIY9QzeoT_lVSNEholQcXdcjF0TQUJmXo7Z4ncZgRv3ykrtvAMuX7g-5hrPsVd65tvz5OQsXJucNBXdPtZgcuwOmtzW_px9Ka-FJtZCx6cOVW5sdd03jNtVA May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:49:57.623493 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6be9af66b7048778fd5b823a1535450"}]}] May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 426d1d2e2b7245afbd688b174059dce5 May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1970653524", "metadata": {"Type": "work"}}} May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: May 27 09:49:57.625349 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1970653524', 'metadata': {'Type': 'work'}}}} May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise error May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi '' May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:57.626651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 09:49:57.628126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 09:49:57.629473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 09:49:57.629473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.629473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dba469fe-71be-480f-abee-0307d0b276f0 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:57.629473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dba469fe-71be-480f-abee-0307d0b276f0 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007341 May 27 09:49:57.629473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 512/1028] 10.222.0.41 () {60 vars in 1155 bytes} [Fri May 27 09:49:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 09:49:57.636511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fe85183f-a226-401f-8e64-eeddfd01b386 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Calling method '.version_select at 0x7f188c2713a0>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:57.667526 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-fe85183f-a226-401f-8e64-eeddfd01b386 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] HTTP exception thrown: Volume tempest-invalid-794288859 could not be found. May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fe85183f-a226-401f-8e64-eeddfd01b386 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Request method failure captured: May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-794288859 HTTP/1.1 May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ7F4XLq_SAV7l8gHwOERKxcCUt9zl9SCV7AAQyMxwf1M9FbFG0RENNTIY9QzeoT_lVSNEholQcXdcjF0TQUJmXo7Z4ncZgRv3ykrtvAMuX7g-5hrPsVd65tvz5OQsXJucNBXdPtZgcuwOmtzW_px9Ka-FJtZCx6cOVW5sdd03jNtVA May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:49:57.669468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6be9af66b7048778fd5b823a1535450"}]}] May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 426d1d2e2b7245afbd688b174059dce5 May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Volume tempest-invalid-794288859 could not be found. May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'tempest-invalid-794288859'} May 27 09:49:57.670765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-794288859 could not be found. (HTTP 404) (Request-ID: req-e800ef22-3dbc-4183-acf6-8db854804403) May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.672202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:49:57.673550 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-794288859 could not be found. May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:49:57.674765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-794288859 could not be found. May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-794288859 could not be found. May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fe85183f-a226-401f-8e64-eeddfd01b386 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Returning 404 to user: Volume tempest-invalid-794288859 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fe85183f-a226-401f-8e64-eeddfd01b386 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-794288859" status: 404 len: 98 microversion: 2.1 time: 0.039949 May 27 09:49:57.676167 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 513/1029] 10.222.0.41 () {58 vars in 1214 bytes} [Fri May 27 09:49:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-794288859 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 27 09:49:57.681505 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ee085a58-c9bf-455a-ba17-475f59381f70 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003608 May 27 09:49:57.682172 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 514/1030] 10.222.0.41 () {58 vars in 1139 bytes} [Fri May 27 09:49:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 09:49:57.689945 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b037807f-59dc-4154-b259-f41af75ab64d tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003345 May 27 09:49:57.690430 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 515/1031] 10.222.0.41 () {58 vars in 1136 bytes} [Fri May 27 09:49:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 27 09:49:57.698870 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3763538e-d374-4b6d-82c2-7f3167785b3a tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Calling method '.version_select at 0x7f1890bc9310>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-3763538e-d374-4b6d-82c2-7f3167785b3a tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] HTTP exception thrown: Volume cc647d9f-3d0f-42ed-b9b2-0da68a731a04 could not be found. May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3763538e-d374-4b6d-82c2-7f3167785b3a tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Request method failure captured: May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/os-volumes/cc647d9f-3d0f-42ed-b9b2-0da68a731a04 HTTP/1.1 May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ7F4XLq_SAV7l8gHwOERKxcCUt9zl9SCV7AAQyMxwf1M9FbFG0RENNTIY9QzeoT_lVSNEholQcXdcjF0TQUJmXo7Z4ncZgRv3ykrtvAMuX7g-5hrPsVd65tvz5OQsXJucNBXdPtZgcuwOmtzW_px9Ka-FJtZCx6cOVW5sdd03jNtVA May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:49:57.729611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6be9af66b7048778fd5b823a1535450"}]}] May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 426d1d2e2b7245afbd688b174059dce5 May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Volume cc647d9f-3d0f-42ed-b9b2-0da68a731a04 could not be found. May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'cc647d9f-3d0f-42ed-b9b2-0da68a731a04'} May 27 09:49:57.733200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cc647d9f-3d0f-42ed-b9b2-0da68a731a04 could not be found. (HTTP 404) (Request-ID: req-81b06efd-433e-4450-ba2a-b6184bb77d40) May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.734671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:49:57.736413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cc647d9f-3d0f-42ed-b9b2-0da68a731a04 could not be found. May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 09:49:57.737920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cc647d9f-3d0f-42ed-b9b2-0da68a731a04 could not be found. May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cc647d9f-3d0f-42ed-b9b2-0da68a731a04 could not be found. May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3763538e-d374-4b6d-82c2-7f3167785b3a tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Returning 404 to user: Volume cc647d9f-3d0f-42ed-b9b2-0da68a731a04 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3763538e-d374-4b6d-82c2-7f3167785b3a tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/cc647d9f-3d0f-42ed-b9b2-0da68a731a04" status: 404 len: 109 microversion: 2.1 time: 0.035312 May 27 09:49:57.742424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 516/1032] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 09:49:57 2022] DELETE /compute/v2.1/os-volumes/cc647d9f-3d0f-42ed-b9b2-0da68a731a04 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 09:49:57.752440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9eb29245-21aa-4d95-bb34-57be4971d438 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Calling method '.version_select at 0x7f188cf45430>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:57.769733 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-9eb29245-21aa-4d95-bb34-57be4971d438 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] HTTP exception thrown: Volume b9b3a558-694b-4465-b542-871f4e56bc16 could not be found. May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9eb29245-21aa-4d95-bb34-57be4971d438 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Request method failure captured: May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/os-volumes/b9b3a558-694b-4465-b542-871f4e56bc16 HTTP/1.1 May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ7F4XLq_SAV7l8gHwOERKxcCUt9zl9SCV7AAQyMxwf1M9FbFG0RENNTIY9QzeoT_lVSNEholQcXdcjF0TQUJmXo7Z4ncZgRv3ykrtvAMuX7g-5hrPsVd65tvz5OQsXJucNBXdPtZgcuwOmtzW_px9Ka-FJtZCx6cOVW5sdd03jNtVA May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:49:57.771316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c6be9af66b7048778fd5b823a1535450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c6be9af66b7048778fd5b823a1535450"}]}] May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: c6be9af66b7048778fd5b823a1535450 May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-VolumesNegativeTest-1331676989 May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 426d1d2e2b7245afbd688b174059dce5 May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-VolumesNegativeTest-1331676989-project May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Volume b9b3a558-694b-4465-b542-871f4e56bc16 could not be found. May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'b9b3a558-694b-4465-b542-871f4e56bc16'} May 27 09:49:57.772954 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9b3a558-694b-4465-b542-871f4e56bc16 could not be found. (HTTP 404) (Request-ID: req-41b76467-cb8e-4803-b519-afd667954ba3) May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.773802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:49:57.774943 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9b3a558-694b-4465-b542-871f4e56bc16 could not be found. May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 09:49:57.776182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9b3a558-694b-4465-b542-871f4e56bc16 could not be found. May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9b3a558-694b-4465-b542-871f4e56bc16 could not be found. May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9eb29245-21aa-4d95-bb34-57be4971d438 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] Returning 404 to user: Volume b9b3a558-694b-4465-b542-871f4e56bc16 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9eb29245-21aa-4d95-bb34-57be4971d438 tempest-VolumesNegativeTest-1331676989 tempest-VolumesNegativeTest-1331676989-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b9b3a558-694b-4465-b542-871f4e56bc16" status: 404 len: 109 microversion: 2.1 time: 0.035122 May 27 09:49:57.778351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 517/1033] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:49:57 2022] GET /compute/v2.1/os-volumes/b9b3a558-694b-4465-b542-871f4e56bc16 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 09:49:57.901372 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-311d5ede-7d9c-41ad-9560-866d433bd38d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297668 May 27 09:49:57.902042 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 517/1034] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:49:57 2022] POST /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:00.877463 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:50:00.878281 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Fri May 27 09:50:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:50:05.423408 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:05.424504 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=5 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:05.429608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b5e45f22-f09b-4538-8f0e-44d3fa0668d3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: .version_select at 0x7f188cf45430>, body: {"keypair": {"name": "tempest-keypair-417833115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqMdpbuECh7+/0SQhs51MQa1fKuTLi6Uks6EB+yuX4JG9pVlxsHsjrrq+zVsnAlH7te/4V+uMMXaQ0o0wRzi+QsRqlHWjw6abF6V4zn+Igho/1lrqo2pR/c9c3mTHdKjg=="}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:05.446324 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-b5e45f22-f09b-4538-8f0e-44d3fa0668d3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for project 43091208be574e6e8cc348667792f751. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:50:05.450094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-b5e45f22-f09b-4538-8f0e-44d3fa0668d3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for user 8d96e9d955934f0e883df57a3bcf934d and project 43091208be574e6e8cc348667792f751. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:50:05.477395 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b5e45f22-f09b-4538-8f0e-44d3fa0668d3 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055402 May 27 09:50:05.478320 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 518/1035] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 09:50:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:06.813025 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1006991282", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f851c882-debd-4ebe-9da5-a1c317e6e8ac"}], "security_groups": [{"name": "tempest-securitygroup--1949666385"}], "key_name": "tempest-keypair-417833115", "user_data": "}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:06.918295 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] validate_networks() for [('f851c882-debd-4ebe-9da5-a1c317e6e8ac', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:50:07.322685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:50:07.323136 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:50:07.323638 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:50:07.324052 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:50:07.324462 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:50:07.333096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:07.333544 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:07.334381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:07.334852 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:07.351946 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for project 43091208be574e6e8cc348667792f751. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:50:07.355806 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for user 8d96e9d955934f0e883df57a3bcf934d and project 43091208be574e6e8cc348667792f751. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:50:07.367020 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:50:07.369385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:50:07.418909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-319d8d0c-d5b7-48f6-b6ea-7d4821633f2a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.611008 May 27 09:50:07.419511 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 518/1036] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:50:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:50:07.430836 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-116cbe3d-3d79-47ab-9daa-639d3823fc12 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:07.431543 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-116cbe3d-3d79-47ab-9daa-639d3823fc12 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:07.487092 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-116cbe3d-3d79-47ab-9daa-639d3823fc12 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:07.494217 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-116cbe3d-3d79-47ab-9daa-639d3823fc12 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1241 microversion: 2.1 time: 0.068637 May 27 09:50:07.494882 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 519/1037] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:07 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:08.512335 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-01cad955-bac0-4225-a3a5-9111a7839266 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:08.513014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-01cad955-bac0-4225-a3a5-9111a7839266 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:08.522074 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-01cad955-bac0-4225-a3a5-9111a7839266 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:08.523055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-01cad955-bac0-4225-a3a5-9111a7839266 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:08.523855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-01cad955-bac0-4225-a3a5-9111a7839266 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:08.524292 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-01cad955-bac0-4225-a3a5-9111a7839266 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:08.608082 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-01cad955-bac0-4225-a3a5-9111a7839266 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:08.619353 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-01cad955-bac0-4225-a3a5-9111a7839266 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1301 microversion: 2.1 time: 0.111217 May 27 09:50:08.620625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 519/1038] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:08 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:09.637918 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cb23f3d9-d817-4a0e-a35e-a59134cc3571 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:09.638585 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cb23f3d9-d817-4a0e-a35e-a59134cc3571 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:09.646033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb23f3d9-d817-4a0e-a35e-a59134cc3571 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:09.646490 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb23f3d9-d817-4a0e-a35e-a59134cc3571 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:09.647305 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb23f3d9-d817-4a0e-a35e-a59134cc3571 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:09.647744 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb23f3d9-d817-4a0e-a35e-a59134cc3571 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:09.899122 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cb23f3d9-d817-4a0e-a35e-a59134cc3571 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:09.906665 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cb23f3d9-d817-4a0e-a35e-a59134cc3571 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.272605 May 27 09:50:09.907232 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 520/1039] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:09 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:10.312751 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-e5686143-7329-4bd6-9217-5dde2519fad6 req-343b35d2-4b4c-4c8a-9c50-a48bfb9cea1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1", "tag": "2b4e04f6-70c5-40ba-9aca-55eb635f816e"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:10.330537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e5686143-7329-4bd6-9217-5dde2519fad6 req-343b35d2-4b4c-4c8a-9c50-a48bfb9cea1b service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:10.331737 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e5686143-7329-4bd6-9217-5dde2519fad6 req-343b35d2-4b4c-4c8a-9c50-a48bfb9cea1b service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:10.347920 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-e5686143-7329-4bd6-9217-5dde2519fad6 req-343b35d2-4b4c-4c8a-9c50-a48bfb9cea1b service nova] Creating event network-changed:2b4e04f6-70c5-40ba-9aca-55eb635f816e for instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 on hv-cinder-79760 May 27 09:50:10.354113 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-e5686143-7329-4bd6-9217-5dde2519fad6 req-343b35d2-4b4c-4c8a-9c50-a48bfb9cea1b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046601 May 27 09:50:10.354766 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 520/1040] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:50:10.922938 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-06742a02-f3ad-47ba-9cc1-72add52a6f92 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:10.923577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-06742a02-f3ad-47ba-9cc1-72add52a6f92 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:10.930446 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-06742a02-f3ad-47ba-9cc1-72add52a6f92 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:10.930886 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-06742a02-f3ad-47ba-9cc1-72add52a6f92 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:10.931668 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-06742a02-f3ad-47ba-9cc1-72add52a6f92 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:10.932102 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-06742a02-f3ad-47ba-9cc1-72add52a6f92 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:11.058350 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-06742a02-f3ad-47ba-9cc1-72add52a6f92 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:11.065866 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-06742a02-f3ad-47ba-9cc1-72add52a6f92 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.146681 May 27 09:50:11.066564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 521/1041] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:10 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:12.084005 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-80a52015-cd12-492f-b9a7-d8e2db802fd8 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:12.084935 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-80a52015-cd12-492f-b9a7-d8e2db802fd8 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:12.093899 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-80a52015-cd12-492f-b9a7-d8e2db802fd8 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:12.094353 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-80a52015-cd12-492f-b9a7-d8e2db802fd8 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:12.095161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-80a52015-cd12-492f-b9a7-d8e2db802fd8 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:12.095615 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-80a52015-cd12-492f-b9a7-d8e2db802fd8 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:12.254378 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-80a52015-cd12-492f-b9a7-d8e2db802fd8 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:12.262522 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-80a52015-cd12-492f-b9a7-d8e2db802fd8 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.183381 May 27 09:50:12.263081 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 521/1042] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:12 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:13.280224 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e1e0471f-806c-45f0-af11-bb64ddd66b08 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:13.281458 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e1e0471f-806c-45f0-af11-bb64ddd66b08 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:13.288624 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e1e0471f-806c-45f0-af11-bb64ddd66b08 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:13.290083 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e1e0471f-806c-45f0-af11-bb64ddd66b08 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:13.290857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e1e0471f-806c-45f0-af11-bb64ddd66b08 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:13.291763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e1e0471f-806c-45f0-af11-bb64ddd66b08 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:13.502412 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e1e0471f-806c-45f0-af11-bb64ddd66b08 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:13.510659 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e1e0471f-806c-45f0-af11-bb64ddd66b08 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.234778 May 27 09:50:13.511466 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 522/1043] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:13 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:14.528111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1c7d8c03-5bcd-4121-ae07-83d1619e1daa tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:14.528723 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1c7d8c03-5bcd-4121-ae07-83d1619e1daa tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:14.535118 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1c7d8c03-5bcd-4121-ae07-83d1619e1daa tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:14.535598 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1c7d8c03-5bcd-4121-ae07-83d1619e1daa tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:14.536360 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1c7d8c03-5bcd-4121-ae07-83d1619e1daa tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:14.536794 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1c7d8c03-5bcd-4121-ae07-83d1619e1daa tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:14.674946 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1c7d8c03-5bcd-4121-ae07-83d1619e1daa tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:14.682814 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1c7d8c03-5bcd-4121-ae07-83d1619e1daa tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.158574 May 27 09:50:14.683393 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 522/1044] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:14 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:50:15.699377 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-219ecbeb-8f54-42ae-908f-7dfc399c0542 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:15.699944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-219ecbeb-8f54-42ae-908f-7dfc399c0542 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:15.706356 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-219ecbeb-8f54-42ae-908f-7dfc399c0542 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:15.706798 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-219ecbeb-8f54-42ae-908f-7dfc399c0542 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:15.707583 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-219ecbeb-8f54-42ae-908f-7dfc399c0542 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:15.708013 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-219ecbeb-8f54-42ae-908f-7dfc399c0542 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:15.839578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-219ecbeb-8f54-42ae-908f-7dfc399c0542 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:15.846904 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-219ecbeb-8f54-42ae-908f-7dfc399c0542 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.151512 May 27 09:50:15.847489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 523/1045] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:15 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:16.863489 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-81602be0-3b38-4534-9a2e-9e206eb86ec6 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:16.864103 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-81602be0-3b38-4534-9a2e-9e206eb86ec6 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:16.871801 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81602be0-3b38-4534-9a2e-9e206eb86ec6 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:16.872246 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81602be0-3b38-4534-9a2e-9e206eb86ec6 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:16.873008 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81602be0-3b38-4534-9a2e-9e206eb86ec6 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:16.873671 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81602be0-3b38-4534-9a2e-9e206eb86ec6 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:17.001370 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-81602be0-3b38-4534-9a2e-9e206eb86ec6 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:17.009664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-81602be0-3b38-4534-9a2e-9e206eb86ec6 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.150043 May 27 09:50:17.010232 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 523/1046] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:16 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:17.351094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-42cf8e67-1fcb-4a44-8a70-b6422dbe1f25 req-2a77eeee-dee0-4152-ad34-3e11b07da4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1", "name": "network-vif-plugged", "status": "completed", "tag": "2b4e04f6-70c5-40ba-9aca-55eb635f816e"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:17.359166 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-42cf8e67-1fcb-4a44-8a70-b6422dbe1f25 req-2a77eeee-dee0-4152-ad34-3e11b07da4a7 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:17.359631 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-42cf8e67-1fcb-4a44-8a70-b6422dbe1f25 req-2a77eeee-dee0-4152-ad34-3e11b07da4a7 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:17.370397 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-42cf8e67-1fcb-4a44-8a70-b6422dbe1f25 req-2a77eeee-dee0-4152-ad34-3e11b07da4a7 service nova] Creating event network-vif-plugged:2b4e04f6-70c5-40ba-9aca-55eb635f816e for instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 on hv-cinder-79760 May 27 09:50:17.375303 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-42cf8e67-1fcb-4a44-8a70-b6422dbe1f25 req-2a77eeee-dee0-4152-ad34-3e11b07da4a7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148835 May 27 09:50:17.375891 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 524/1047] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:18.025749 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-a0844e09-d788-403b-a16c-bb875c893029 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:18.026356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-a0844e09-d788-403b-a16c-bb875c893029 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:18.028276 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:18.028922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=6 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:18.034993 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a0844e09-d788-403b-a16c-bb875c893029 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:18.035478 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a0844e09-d788-403b-a16c-bb875c893029 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:18.036247 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a0844e09-d788-403b-a16c-bb875c893029 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:18.036683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-a0844e09-d788-403b-a16c-bb875c893029 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:18.168067 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-a0844e09-d788-403b-a16c-bb875c893029 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:18.175356 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-a0844e09-d788-403b-a16c-bb875c893029 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.153391 May 27 09:50:18.175952 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 524/1048] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:18 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:19.189722 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=6 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:19.194431 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-95c848ba-c1d4-428d-a105-c8531bfe97e5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:19.195730 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-95c848ba-c1d4-428d-a105-c8531bfe97e5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:19.202326 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-95c848ba-c1d4-428d-a105-c8531bfe97e5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:19.202773 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-95c848ba-c1d4-428d-a105-c8531bfe97e5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:19.203567 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-95c848ba-c1d4-428d-a105-c8531bfe97e5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:19.204005 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-95c848ba-c1d4-428d-a105-c8531bfe97e5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:19.332589 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-95c848ba-c1d4-428d-a105-c8531bfe97e5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:19.340194 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-95c848ba-c1d4-428d-a105-c8531bfe97e5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.151412 May 27 09:50:19.340770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 525/1049] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:19 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:20.356641 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-386c24fe-82b0-45ca-9dc4-45edb66f580e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:20.357273 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-386c24fe-82b0-45ca-9dc4-45edb66f580e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:20.363643 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-386c24fe-82b0-45ca-9dc4-45edb66f580e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:20.364087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-386c24fe-82b0-45ca-9dc4-45edb66f580e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:20.364844 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-386c24fe-82b0-45ca-9dc4-45edb66f580e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:20.365272 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-386c24fe-82b0-45ca-9dc4-45edb66f580e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:20.518425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-386c24fe-82b0-45ca-9dc4-45edb66f580e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:20.526670 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-386c24fe-82b0-45ca-9dc4-45edb66f580e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.173808 May 27 09:50:20.527239 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 525/1050] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:20 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:21.543018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cfe5a8b8-817c-40ad-aed2-6c61eb0d1940 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:21.543661 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cfe5a8b8-817c-40ad-aed2-6c61eb0d1940 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:21.550065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cfe5a8b8-817c-40ad-aed2-6c61eb0d1940 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:21.550508 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cfe5a8b8-817c-40ad-aed2-6c61eb0d1940 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:21.551262 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cfe5a8b8-817c-40ad-aed2-6c61eb0d1940 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:21.551720 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cfe5a8b8-817c-40ad-aed2-6c61eb0d1940 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:21.675009 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-cfe5a8b8-817c-40ad-aed2-6c61eb0d1940 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:21.682778 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cfe5a8b8-817c-40ad-aed2-6c61eb0d1940 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.144266 May 27 09:50:21.683421 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 526/1051] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:21 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:22.700055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9a40b43e-645c-4c2b-a958-3851b9a23591 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:22.700684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9a40b43e-645c-4c2b-a958-3851b9a23591 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:22.706591 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9a40b43e-645c-4c2b-a958-3851b9a23591 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:22.707044 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9a40b43e-645c-4c2b-a958-3851b9a23591 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:22.707842 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9a40b43e-645c-4c2b-a958-3851b9a23591 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:22.708281 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9a40b43e-645c-4c2b-a958-3851b9a23591 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:22.845188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9a40b43e-645c-4c2b-a958-3851b9a23591 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:22.853185 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9a40b43e-645c-4c2b-a958-3851b9a23591 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.157574 May 27 09:50:22.853739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 526/1052] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:22 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:23.870039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5442baa2-04d3-43d1-b922-2f00d5807322 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:23.870607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5442baa2-04d3-43d1-b922-2f00d5807322 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:23.877121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5442baa2-04d3-43d1-b922-2f00d5807322 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:23.877575 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5442baa2-04d3-43d1-b922-2f00d5807322 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:23.878347 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5442baa2-04d3-43d1-b922-2f00d5807322 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:23.878789 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5442baa2-04d3-43d1-b922-2f00d5807322 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:24.004278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5442baa2-04d3-43d1-b922-2f00d5807322 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:24.012681 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5442baa2-04d3-43d1-b922-2f00d5807322 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.146622 May 27 09:50:24.013257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 527/1053] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:23 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:25.030533 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1cbaf987-6c7d-43b2-83ca-e39ed1d4790d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:25.031170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1cbaf987-6c7d-43b2-83ca-e39ed1d4790d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:25.037730 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1cbaf987-6c7d-43b2-83ca-e39ed1d4790d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:25.038168 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1cbaf987-6c7d-43b2-83ca-e39ed1d4790d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:25.038954 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1cbaf987-6c7d-43b2-83ca-e39ed1d4790d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:25.040023 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1cbaf987-6c7d-43b2-83ca-e39ed1d4790d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:25.168783 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1cbaf987-6c7d-43b2-83ca-e39ed1d4790d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:25.176119 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1cbaf987-6c7d-43b2-83ca-e39ed1d4790d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1367 microversion: 2.1 time: 0.149461 May 27 09:50:25.176687 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 527/1054] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:25 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:26.192817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-801f3d61-7192-43b2-afe8-f54f0f9ed18f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:26.193427 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-801f3d61-7192-43b2-afe8-f54f0f9ed18f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:26.200459 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-801f3d61-7192-43b2-afe8-f54f0f9ed18f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:26.200909 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-801f3d61-7192-43b2-afe8-f54f0f9ed18f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:26.201700 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-801f3d61-7192-43b2-afe8-f54f0f9ed18f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:26.202143 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-801f3d61-7192-43b2-afe8-f54f0f9ed18f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:26.330305 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-801f3d61-7192-43b2-afe8-f54f0f9ed18f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:26.338356 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-801f3d61-7192-43b2-afe8-f54f0f9ed18f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1557 microversion: 2.1 time: 0.149352 May 27 09:50:26.339181 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 528/1055] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:26 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:26.354374 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ee1aa3f1-22ef-42d8-ad14-7c847c050946 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:26.354885 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ee1aa3f1-22ef-42d8-ad14-7c847c050946 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:26.361251 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ee1aa3f1-22ef-42d8-ad14-7c847c050946 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:26.361691 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ee1aa3f1-22ef-42d8-ad14-7c847c050946 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:26.362446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ee1aa3f1-22ef-42d8-ad14-7c847c050946 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:26.362879 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ee1aa3f1-22ef-42d8-ad14-7c847c050946 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:26.438364 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ee1aa3f1-22ef-42d8-ad14-7c847c050946 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087761 May 27 09:50:26.438952 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 528/1056] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 09:50:26 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:27.363073 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-2965c1cf-6567-4131-b4dc-fb42eba8a00d req-ac6fd935-c13a-452b-b765-553fcde6354d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1", "tag": "2b4e04f6-70c5-40ba-9aca-55eb635f816e"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:27.371517 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-2965c1cf-6567-4131-b4dc-fb42eba8a00d req-ac6fd935-c13a-452b-b765-553fcde6354d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:27.371955 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-2965c1cf-6567-4131-b4dc-fb42eba8a00d req-ac6fd935-c13a-452b-b765-553fcde6354d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:27.382480 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-2965c1cf-6567-4131-b4dc-fb42eba8a00d req-ac6fd935-c13a-452b-b765-553fcde6354d service nova] Creating event network-changed:2b4e04f6-70c5-40ba-9aca-55eb635f816e for instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 on hv-cinder-79760 May 27 09:50:27.387546 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-2965c1cf-6567-4131-b4dc-fb42eba8a00d req-ac6fd935-c13a-452b-b765-553fcde6354d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027980 May 27 09:50:27.388182 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 529/1057] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:46.059527 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:46.064939 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:46.066333 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7dce3a71-1777-43af-ac80-094a1e8823b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:46.068089 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7dce3a71-1777-43af-ac80-094a1e8823b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:46.077961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7dce3a71-1777-43af-ac80-094a1e8823b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:46.078571 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7dce3a71-1777-43af-ac80-094a1e8823b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:46.079471 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7dce3a71-1777-43af-ac80-094a1e8823b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:46.080006 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7dce3a71-1777-43af-ac80-094a1e8823b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:46.111826 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7dce3a71-1777-43af-ac80-094a1e8823b1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053630 May 27 09:50:46.117137 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 529/1058] 10.222.0.41 () {60 vars in 1342 bytes} [Fri May 27 09:50:46 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:46.176430 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-0374545b-2442-4525-9ca2-be27b26b66b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:46.177826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0374545b-2442-4525-9ca2-be27b26b66b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:46.185857 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:46.187228 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=52 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:46.189432 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0374545b-2442-4525-9ca2-be27b26b66b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:46.190065 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0374545b-2442-4525-9ca2-be27b26b66b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:46.191108 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0374545b-2442-4525-9ca2-be27b26b66b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:46.191576 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-0374545b-2442-4525-9ca2-be27b26b66b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:46.235410 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-0374545b-2442-4525-9ca2-be27b26b66b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:50:46.362014 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-0374545b-2442-4525-9ca2-be27b26b66b4 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "DELETE /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 204 len: 0 microversion: 2.20 time: 0.190117 May 27 09:50:46.366369 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 530/1059] 10.222.0.41 () {60 vars in 1279 bytes} [Fri May 27 09:50:46 2022] DELETE /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 09:50:46.372190 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8e734980-7f37-4747-a24c-8d4276742461 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:46.372958 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8e734980-7f37-4747-a24c-8d4276742461 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:46.379834 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8e734980-7f37-4747-a24c-8d4276742461 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:46.380347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8e734980-7f37-4747-a24c-8d4276742461 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:46.381439 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8e734980-7f37-4747-a24c-8d4276742461 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:46.381913 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8e734980-7f37-4747-a24c-8d4276742461 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:46.619969 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8e734980-7f37-4747-a24c-8d4276742461 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:46.628887 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8e734980-7f37-4747-a24c-8d4276742461 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:46.630405 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8e734980-7f37-4747-a24c-8d4276742461 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:46.655968 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8e734980-7f37-4747-a24c-8d4276742461 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.264384 May 27 09:50:46.656944 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 530/1060] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:50:46 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:50:47.677351 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-bac52ca1-9eaa-48d3-84e4-93d6300e3da6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:47.678693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bac52ca1-9eaa-48d3-84e4-93d6300e3da6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:47.702085 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bac52ca1-9eaa-48d3-84e4-93d6300e3da6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:47.702774 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bac52ca1-9eaa-48d3-84e4-93d6300e3da6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:47.704228 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bac52ca1-9eaa-48d3-84e4-93d6300e3da6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:47.705511 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bac52ca1-9eaa-48d3-84e4-93d6300e3da6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:47.910083 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bac52ca1-9eaa-48d3-84e4-93d6300e3da6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:47.919724 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bac52ca1-9eaa-48d3-84e4-93d6300e3da6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:47.921411 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bac52ca1-9eaa-48d3-84e4-93d6300e3da6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:47.927974 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-bac52ca1-9eaa-48d3-84e4-93d6300e3da6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1721 microversion: 2.20 time: 0.257179 May 27 09:50:47.928959 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 531/1061] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:50:47 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:50:48.717990 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-704564f9-8d57-44bb-9371-4577d7ff9d4f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Action: 'create', calling method: .version_select at 0x7f188c3131f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-830294606", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc8CBJyUbXycf3RprrZLltb7meEqEE5lOv2zVzgaGEAmpdC5k4ZJmt9L/D47oBzydYGZSn2C4UzEZpCbYGttarmZL3BdEtWJciq2SQX8VR+7BrBKnVo998Wo+8ldVhrKw=="}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:48.733297 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-704564f9-8d57-44bb-9371-4577d7ff9d4f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Getting quotas for project 0fb2f335c9b540af8f7119c85656efad. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:50:48.737405 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-704564f9-8d57-44bb-9371-4577d7ff9d4f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Getting quotas for user f1fa5f1765ed4995b31a1600ce3edb07 and project 0fb2f335c9b540af8f7119c85656efad. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:50:48.761441 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-704564f9-8d57-44bb-9371-4577d7ff9d4f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.234231 May 27 09:50:48.762576 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 531/1062] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 09:50:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:50:48.950951 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-32fc441c-ee04-4225-a8dd-ba1d063e25e6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:48.952136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-32fc441c-ee04-4225-a8dd-ba1d063e25e6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:48.958482 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-32fc441c-ee04-4225-a8dd-ba1d063e25e6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:48.959544 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-32fc441c-ee04-4225-a8dd-ba1d063e25e6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:48.961397 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-32fc441c-ee04-4225-a8dd-ba1d063e25e6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:48.962176 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-32fc441c-ee04-4225-a8dd-ba1d063e25e6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:49.095138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-32fc441c-ee04-4225-a8dd-ba1d063e25e6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:49.112616 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-32fc441c-ee04-4225-a8dd-ba1d063e25e6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:49.114427 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-32fc441c-ee04-4225-a8dd-ba1d063e25e6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5b0d25ff6a664177b463b834124802d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb8746f17d6410f9c82d0fde348d1f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:49.116237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-32fc441c-ee04-4225-a8dd-ba1d063e25e6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 200 len: 1654 microversion: 2.20 time: 0.168802 May 27 09:50:49.117252 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 532/1063] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:50:48 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 1654 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:50:49.242014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-e7f33e4a-40e4-42a2-8d2f-943a2676b8c1 req-a47994c4-c6f5-433d-a62a-81c4e965c61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330ed71b-ab48-42b7-b46e-98be00f7343e", "name": "network-vif-deleted", "tag": "9011439f-1b54-4948-87ab-dd7cd4f186e5"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:49.271385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e7f33e4a-40e4-42a2-8d2f-943a2676b8c1 req-a47994c4-c6f5-433d-a62a-81c4e965c61f service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:49.271839 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e7f33e4a-40e4-42a2-8d2f-943a2676b8c1 req-a47994c4-c6f5-433d-a62a-81c4e965c61f service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:49.302655 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-e7f33e4a-40e4-42a2-8d2f-943a2676b8c1 req-a47994c4-c6f5-433d-a62a-81c4e965c61f service nova] Creating event network-vif-deleted:9011439f-1b54-4948-87ab-dd7cd4f186e5 for instance 330ed71b-ab48-42b7-b46e-98be00f7343e on hv-cinder-79760 May 27 09:50:49.320158 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-e7f33e4a-40e4-42a2-8d2f-943a2676b8c1 req-a47994c4-c6f5-433d-a62a-81c4e965c61f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084073 May 27 09:50:49.320774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 532/1064] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:50.135944 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9674804d-ea92-4623-98af-bc9e087cfab8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:50.136648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9674804d-ea92-4623-98af-bc9e087cfab8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:50.152170 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9674804d-ea92-4623-98af-bc9e087cfab8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:50.153278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9674804d-ea92-4623-98af-bc9e087cfab8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:50.154434 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9674804d-ea92-4623-98af-bc9e087cfab8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:50.155572 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9674804d-ea92-4623-98af-bc9e087cfab8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:50.177268 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-9674804d-ea92-4623-98af-bc9e087cfab8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] HTTP exception thrown: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9674804d-ea92-4623-98af-bc9e087cfab8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Request method failure captured: May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e HTTP/1.1 May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJw5EXjX8LWOR8bY7cVtutIr3ut5ZjUPwezeUUgcPqFbRCWaMsW1gFI6VV_uTtxJ5eV9bFz4hXnlsQnVIykcWOla6y8sjkM9lnjcjNWN4gSEwP_UOvLsVD10-bFaNt2uVhzA1d9dcffu7abGWtddEF6xxNOyjX2vIx3L7S-q8Uz6ueo May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:50:50.179317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fbb8746f17d6410f9c82d0fde348d1f9"}]}] May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 5b0d25ff6a664177b463b834124802d5 May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:50.181068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '330ed71b-ab48-42b7-b46e-98be00f7343e'} May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:50:50.182020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:50.183651 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:50:50.185052 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9674804d-ea92-4623-98af-bc9e087cfab8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Returning 404 to user: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:50:50.185052 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9674804d-ea92-4623-98af-bc9e087cfab8 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 404 len: 111 microversion: 2.20 time: 0.054396 May 27 09:50:50.187360 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 533/1065] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:50:50 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 09:50:50.195513 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e9c61418-b9c0-4f70-88ef-c19606871ce6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '.version_select at 0x7f188c313a60>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:50.236246 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e9c61418-b9c0-4f70-88ef-c19606871ce6 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782480409" status: 204 len: 0 microversion: 2.20 time: 0.043860 May 27 09:50:50.240233 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 533/1066] 10.222.0.41 () {60 vars in 1261 bytes} [Fri May 27 09:50:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782480409 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 09:50:50.997341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-e431be4e-545c-4834-8bb3-3653ca1c0e03 req-37836eee-667c-4430-b8fe-467f33585e36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74dd536e-b54a-4af0-8010-b44bca82fbe9", "tag": "a7bf0759-e717-4ad7-bf72-ba59bd3a1455"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:51.001272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-353a7d7a-4db9-4a1c-a4f1-15a9d90ce51b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:51.003611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-353a7d7a-4db9-4a1c-a4f1-15a9d90ce51b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:51.017207 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-353a7d7a-4db9-4a1c-a4f1-15a9d90ce51b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:51.024492 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-353a7d7a-4db9-4a1c-a4f1-15a9d90ce51b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:51.027515 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-353a7d7a-4db9-4a1c-a4f1-15a9d90ce51b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:51.029715 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-353a7d7a-4db9-4a1c-a4f1-15a9d90ce51b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:51.038068 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e431be4e-545c-4834-8bb3-3653ca1c0e03 req-37836eee-667c-4430-b8fe-467f33585e36 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:51.039009 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-e431be4e-545c-4834-8bb3-3653ca1c0e03 req-37836eee-667c-4430-b8fe-467f33585e36 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:51.069599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-e431be4e-545c-4834-8bb3-3653ca1c0e03 req-37836eee-667c-4430-b8fe-467f33585e36 service nova] Creating event network-changed:a7bf0759-e717-4ad7-bf72-ba59bd3a1455 for instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 on hv-cinder-79760 May 27 09:50:51.085463 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-353a7d7a-4db9-4a1c-a4f1-15a9d90ce51b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:50:51.093406 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-e431be4e-545c-4834-8bb3-3653ca1c0e03 req-37836eee-667c-4430-b8fe-467f33585e36 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096007 May 27 09:50:51.096961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 534/1067] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:51.257607 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-353a7d7a-4db9-4a1c-a4f1-15a9d90ce51b tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "DELETE /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 204 len: 0 microversion: 2.1 time: 0.266083 May 27 09:50:51.259146 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 534/1068] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:50:50 2022] DELETE /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:50:51.269209 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d99d6fd3-1558-41f6-a43c-26a9ec05fbeb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:51.271293 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d99d6fd3-1558-41f6-a43c-26a9ec05fbeb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:51.284321 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d99d6fd3-1558-41f6-a43c-26a9ec05fbeb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:51.286832 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d99d6fd3-1558-41f6-a43c-26a9ec05fbeb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:51.287909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d99d6fd3-1558-41f6-a43c-26a9ec05fbeb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:51.291591 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d99d6fd3-1558-41f6-a43c-26a9ec05fbeb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:51.516787 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d99d6fd3-1558-41f6-a43c-26a9ec05fbeb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:51.532078 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d99d6fd3-1558-41f6-a43c-26a9ec05fbeb tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.268200 May 27 09:50:51.542479 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 535/1069] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:51 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:52.553580 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a0f2b8de-6be9-4a43-aa09-d4925a671428 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:52.556459 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a0f2b8de-6be9-4a43-aa09-d4925a671428 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:52.580033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a0f2b8de-6be9-4a43-aa09-d4925a671428 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:52.581179 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a0f2b8de-6be9-4a43-aa09-d4925a671428 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:52.582640 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a0f2b8de-6be9-4a43-aa09-d4925a671428 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:52.583484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a0f2b8de-6be9-4a43-aa09-d4925a671428 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:52.608533 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bbbdce65-6434-476f-9f7d-54f9ad76a866 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:52.610000 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bbbdce65-6434-476f-9f7d-54f9ad76a866 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:52.617230 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bbbdce65-6434-476f-9f7d-54f9ad76a866 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:52.618140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bbbdce65-6434-476f-9f7d-54f9ad76a866 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:52.622851 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bbbdce65-6434-476f-9f7d-54f9ad76a866 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:52.623644 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bbbdce65-6434-476f-9f7d-54f9ad76a866 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:52.666153 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-bbbdce65-6434-476f-9f7d-54f9ad76a866 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] HTTP exception thrown: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bbbdce65-6434-476f-9f7d-54f9ad76a866 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Request method failure captured: May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: DELETE /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e HTTP/1.1 May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJw5EXjX8LWOR8bY7cVtutIr3ut5ZjUPwezeUUgcPqFbRCWaMsW1gFI6VV_uTtxJ5eV9bFz4hXnlsQnVIykcWOla6y8sjkM9lnjcjNWN4gSEwP_UOvLsVD10-bFaNt2uVhzA1d9dcffu7abGWtddEF6xxNOyjX2vIx3L7S-q8Uz6ueo May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:50:52.669836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fbb8746f17d6410f9c82d0fde348d1f9"}]}] May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 5b0d25ff6a664177b463b834124802d5 May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:52.671301 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '330ed71b-ab48-42b7-b46e-98be00f7343e'} May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:50:52.672110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:52.674027 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:52.676665 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bbbdce65-6434-476f-9f7d-54f9ad76a866 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Returning 404 to user: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:50:52.676665 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bbbdce65-6434-476f-9f7d-54f9ad76a866 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "DELETE /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 404 len: 111 microversion: 2.20 time: 0.066850 May 27 09:50:52.676665 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 536/1070] 10.222.0.41 () {60 vars in 1279 bytes} [Fri May 27 09:50:52 2022] DELETE /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 27 09:50:52.684279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-64930776-0f31-445e-b240-a193e0c685e1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:52.684930 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-64930776-0f31-445e-b240-a193e0c685e1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: 330ed71b-ab48-42b7-b46e-98be00f7343e] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:52.699781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-64930776-0f31-445e-b240-a193e0c685e1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:52.702170 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-64930776-0f31-445e-b240-a193e0c685e1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:52.705481 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-64930776-0f31-445e-b240-a193e0c685e1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:52.706279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-64930776-0f31-445e-b240-a193e0c685e1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:52.724729 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-64930776-0f31-445e-b240-a193e0c685e1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] HTTP exception thrown: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-64930776-0f31-445e-b240-a193e0c685e1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Request method failure captured: May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e HTTP/1.1 May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJw5EXjX8LWOR8bY7cVtutIr3ut5ZjUPwezeUUgcPqFbRCWaMsW1gFI6VV_uTtxJ5eV9bFz4hXnlsQnVIykcWOla6y8sjkM9lnjcjNWN4gSEwP_UOvLsVD10-bFaNt2uVhzA1d9dcffu7abGWtddEF6xxNOyjX2vIx3L7S-q8Uz6ueo May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:50:52.729318 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fbb8746f17d6410f9c82d0fde348d1f9"}]}] May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 5b0d25ff6a664177b463b834124802d5 May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:52.731091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '330ed71b-ab48-42b7-b46e-98be00f7343e'} May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:50:52.732046 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. May 27 09:50:52.733532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:52.735655 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-64930776-0f31-445e-b240-a193e0c685e1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Returning 404 to user: Instance 330ed71b-ab48-42b7-b46e-98be00f7343e could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:50:52.736547 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-64930776-0f31-445e-b240-a193e0c685e1 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e" status: 404 len: 111 microversion: 2.20 time: 0.059661 May 27 09:50:52.737136 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 537/1071] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:50:52 2022] GET /compute/v2.1/servers/330ed71b-ab48-42b7-b46e-98be00f7343e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 09:50:52.982647 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a0f2b8de-6be9-4a43-aa09-d4925a671428 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:52.991518 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a0f2b8de-6be9-4a43-aa09-d4925a671428 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1569 microversion: 2.1 time: 0.444965 May 27 09:50:52.992352 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 535/1072] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:52 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1569 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:53.912529 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fecd30a5-d1c5-4f8f-ab34-9213f66a525a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:53.913061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fecd30a5-d1c5-4f8f-ab34-9213f66a525a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:53.920843 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fecd30a5-d1c5-4f8f-ab34-9213f66a525a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:53.931339 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-d4d28d76-756d-4deb-b78f-c4322d6ab0a4 req-826dd382-75e5-4393-aee5-f24298bf9ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74dd536e-b54a-4af0-8010-b44bca82fbe9", "name": "network-vif-deleted", "tag": "a7bf0759-e717-4ad7-bf72-ba59bd3a1455"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:53.933847 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fecd30a5-d1c5-4f8f-ab34-9213f66a525a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:53.934955 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fecd30a5-d1c5-4f8f-ab34-9213f66a525a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:53.935411 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fecd30a5-d1c5-4f8f-ab34-9213f66a525a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:53.955159 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-d4d28d76-756d-4deb-b78f-c4322d6ab0a4 req-826dd382-75e5-4393-aee5-f24298bf9ee3 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:53.956018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-d4d28d76-756d-4deb-b78f-c4322d6ab0a4 req-826dd382-75e5-4393-aee5-f24298bf9ee3 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:53.956694 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-fecd30a5-d1c5-4f8f-ab34-9213f66a525a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] HTTP exception thrown: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fecd30a5-d1c5-4f8f-ab34-9213f66a525a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Request method failure captured: May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: DELETE /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 HTTP/1.1 May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJw5EXjX8LWOR8bY7cVtutIr3ut5ZjUPwezeUUgcPqFbRCWaMsW1gFI6VV_uTtxJ5eV9bFz4hXnlsQnVIykcWOla6y8sjkM9lnjcjNWN4gSEwP_UOvLsVD10-bFaNt2uVhzA1d9dcffu7abGWtddEF6xxNOyjX2vIx3L7S-q8Uz6ueo May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:50:53.958279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fbb8746f17d6410f9c82d0fde348d1f9"}]}] May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 5b0d25ff6a664177b463b834124802d5 May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:50:53.959822 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': 'c7937af8-bbeb-4a70-bd98-1062cbe0d4c7'} May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:50:53.964140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:50:53.965631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:53.967189 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fecd30a5-d1c5-4f8f-ab34-9213f66a525a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Returning 404 to user: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:50:53.967189 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fecd30a5-d1c5-4f8f-ab34-9213f66a525a tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 404 len: 111 microversion: 2.20 time: 0.054093 May 27 09:50:53.967189 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 538/1073] 10.222.0.41 () {60 vars in 1279 bytes} [Fri May 27 09:50:53 2022] DELETE /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 27 09:50:53.982483 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4d19a8b6-43bc-4c47-adcc-6f3b101fb183 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:53.984671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-d4d28d76-756d-4deb-b78f-c4322d6ab0a4 req-826dd382-75e5-4393-aee5-f24298bf9ee3 service nova] Creating event network-vif-deleted:a7bf0759-e717-4ad7-bf72-ba59bd3a1455 for instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 on hv-cinder-79760 May 27 09:50:53.985935 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4d19a8b6-43bc-4c47-adcc-6f3b101fb183 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] [instance: c7937af8-bbeb-4a70-bd98-1062cbe0d4c7] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:53.990037 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-d4d28d76-756d-4deb-b78f-c4322d6ab0a4 req-826dd382-75e5-4393-aee5-f24298bf9ee3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063441 May 27 09:50:53.990839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 536/1074] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:50:53.995979 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4d19a8b6-43bc-4c47-adcc-6f3b101fb183 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:53.996712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4d19a8b6-43bc-4c47-adcc-6f3b101fb183 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:53.997748 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4d19a8b6-43bc-4c47-adcc-6f3b101fb183 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:53.998428 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4d19a8b6-43bc-4c47-adcc-6f3b101fb183 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:54.016909 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a973df80-9f39-475f-8256-b299d630e7d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:54.018993 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a973df80-9f39-475f-8256-b299d630e7d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:54.021400 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-4d19a8b6-43bc-4c47-adcc-6f3b101fb183 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] HTTP exception thrown: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4d19a8b6-43bc-4c47-adcc-6f3b101fb183 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Request method failure captured: May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 HTTP/1.1 May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJw5EXjX8LWOR8bY7cVtutIr3ut5ZjUPwezeUUgcPqFbRCWaMsW1gFI6VV_uTtxJ5eV9bFz4hXnlsQnVIykcWOla6y8sjkM9lnjcjNWN4gSEwP_UOvLsVD10-bFaNt2uVhzA1d9dcffu7abGWtddEF6xxNOyjX2vIx3L7S-q8Uz6ueo May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:50:54.023359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/fbb8746f17d6410f9c82d0fde348d1f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_fbb8746f17d6410f9c82d0fde348d1f9"}]}] May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: fbb8746f17d6410f9c82d0fde348d1f9 May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-904274959 May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 5b0d25ff6a664177b463b834124802d5 May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeShelveTestJSON-904274959-project May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:50:54.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': 'c7937af8-bbeb-4a70-bd98-1062cbe0d4c7'} May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:50:54.026165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. May 27 09:50:54.027425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:54.031366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a973df80-9f39-475f-8256-b299d630e7d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:54.031366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a973df80-9f39-475f-8256-b299d630e7d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:54.031366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a973df80-9f39-475f-8256-b299d630e7d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:54.033735 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4d19a8b6-43bc-4c47-adcc-6f3b101fb183 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] Returning 404 to user: Instance c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:50:54.034839 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4d19a8b6-43bc-4c47-adcc-6f3b101fb183 tempest-AttachVolumeShelveTestJSON-904274959 tempest-AttachVolumeShelveTestJSON-904274959-project] 10.222.0.41 "GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7" status: 404 len: 111 microversion: 2.20 time: 0.060578 May 27 09:50:54.037105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 539/1075] 10.222.0.41 () {60 vars in 1276 bytes} [Fri May 27 09:50:53 2022] GET /compute/v2.1/servers/c7937af8-bbeb-4a70-bd98-1062cbe0d4c7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 09:50:54.044094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a973df80-9f39-475f-8256-b299d630e7d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:54.148328 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a973df80-9f39-475f-8256-b299d630e7d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1a972ace154e93aeb19a53930fd306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed0733b1ce342f2a6ecac960523f85f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:54.156468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a973df80-9f39-475f-8256-b299d630e7d2 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 200 len: 1219 microversion: 2.1 time: 0.143841 May 27 09:50:54.166926 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 537/1076] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:54 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:55.174103 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9d98bfd5-c107-4a9a-9213-2c13da9ea644 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:55.174928 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9d98bfd5-c107-4a9a-9213-2c13da9ea644 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] [instance: 74dd536e-b54a-4af0-8010-b44bca82fbe9] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:55.181674 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9d98bfd5-c107-4a9a-9213-2c13da9ea644 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:55.182195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9d98bfd5-c107-4a9a-9213-2c13da9ea644 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:55.183117 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9d98bfd5-c107-4a9a-9213-2c13da9ea644 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:55.183766 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9d98bfd5-c107-4a9a-9213-2c13da9ea644 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:55.203399 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-9d98bfd5-c107-4a9a-9213-2c13da9ea644 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] HTTP exception thrown: Instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 could not be found. May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9d98bfd5-c107-4a9a-9213-2c13da9ea644 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Request method failure captured: May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 HTTP/1.1 May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ2WX0zuagKrnAPSCYjFFi5slbUYPQRUAtQqqyeWvEWojlIo5p_mkw-JDI0GlFLI2E8Eij3rcc8V6Z4V8kP52VwTvBXzBv6FwhGBZ1NR3HHH-T1c-ALfk_1DIMBHwKXubpUBPIKU0e1CIYtbGmWbEiMxkGQ7xyIEnPLRJCtgw7-uRlU May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 2ed0733b1ce342f2a6ecac960523f85f May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-TestShelveInstance-1657774236 May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:50:55.205061 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/2ed0733b1ce342f2a6ecac960523f85f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/2ed0733b1ce342f2a6ecac960523f85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/2ed0733b1ce342f2a6ecac960523f85f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_2ed0733b1ce342f2a6ecac960523f85f"}]}] May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-TestShelveInstance-1657774236 May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 2ed0733b1ce342f2a6ecac960523f85f May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-TestShelveInstance-1657774236 May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-TestShelveInstance-1657774236-project May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 5b1a972ace154e93aeb19a53930fd306 May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-TestShelveInstance-1657774236-project May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 could not be found. May 27 09:50:55.206682 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '74dd536e-b54a-4af0-8010-b44bca82fbe9'} May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 could not be found. May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:50:55.207676 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 could not be found. May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 could not be found. May 27 09:50:55.209266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:50:55.210458 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9d98bfd5-c107-4a9a-9213-2c13da9ea644 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Returning 404 to user: Instance 74dd536e-b54a-4af0-8010-b44bca82fbe9 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:50:55.210458 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9d98bfd5-c107-4a9a-9213-2c13da9ea644 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9" status: 404 len: 111 microversion: 2.1 time: 0.036800 May 27 09:50:55.210458 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 540/1077] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:50:55 2022] GET /compute/v2.1/servers/74dd536e-b54a-4af0-8010-b44bca82fbe9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:50:55.442918 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-103efe03-030f-4429-9b40-f2a4f63c5c91 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] Calling method '.version_select at 0x7f188c4b31f0>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:55.476569 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-103efe03-030f-4429-9b40-f2a4f63c5c91 tempest-TestShelveInstance-1657774236 tempest-TestShelveInstance-1657774236-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-304498852" status: 202 len: 0 microversion: 2.1 time: 0.039368 May 27 09:50:55.477171 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 538/1078] 10.222.0.41 () {58 vars in 1250 bytes} [Fri May 27 09:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-304498852 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:51:20.325152 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2085794623", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-830294606", "security_groups": [{"name": "tempest-secgroup-smoke-861602896"}], "block_device_mapping_v2": [{"uuid": "32843338-6137-49ff-bbd8-3340dd4e10d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f077ba7a-e018-4516-8e3d-23ac2b5e2506"}]}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:51:20.335144 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=4 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:20.335862 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:20.336469 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=32 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:20.441514 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] validate_networks() for [('f077ba7a-e018-4516-8e3d-23ac2b5e2506', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:51:20.825502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:51:20.825921 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:51:20.826389 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:51:20.826791 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:51:20.827197 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:51:20.837773 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:20.839013 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:20.840211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:20.840749 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:20.859864 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Getting quotas for project 0fb2f335c9b540af8f7119c85656efad. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:51:20.863805 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Getting quotas for user f1fa5f1765ed4995b31a1600ce3edb07 and project 0fb2f335c9b540af8f7119c85656efad. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:51:20.920422 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:51:20.922614 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32843338-6137-49ff-bbd8-3340dd4e10d9',volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:51:21.061871 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-624cecf9-c90d-4526-ac29-4bb16fcd6a27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.744028 May 27 09:51:21.062628 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 541/1079] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:51:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:51:21.073334 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:21.074624 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:21.078917 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9c4ad4ed-4706-4bff-b1f1-c6b5c3f8a213 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:21.079554 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9c4ad4ed-4706-4bff-b1f1-c6b5c3f8a213 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:21.141620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9c4ad4ed-4706-4bff-b1f1-c6b5c3f8a213 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:21.150198 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9c4ad4ed-4706-4bff-b1f1-c6b5c3f8a213 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1094 microversion: 2.1 time: 0.079070 May 27 09:51:21.151478 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 539/1080] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:21 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:51:22.171728 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1896f456-be22-4b1b-a1df-14f6ac58535b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:22.172631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1896f456-be22-4b1b-a1df-14f6ac58535b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:22.199599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1896f456-be22-4b1b-a1df-14f6ac58535b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:22.200673 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1896f456-be22-4b1b-a1df-14f6ac58535b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:22.201871 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1896f456-be22-4b1b-a1df-14f6ac58535b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:22.202513 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1896f456-be22-4b1b-a1df-14f6ac58535b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:22.279307 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1896f456-be22-4b1b-a1df-14f6ac58535b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:22.288898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1896f456-be22-4b1b-a1df-14f6ac58535b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1210 microversion: 2.1 time: 0.124137 May 27 09:51:22.309647 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 542/1081] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:22 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1210 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:23.310126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ea0110e1-ca04-4990-bfe2-fffe787f3be2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:23.310765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ea0110e1-ca04-4990-bfe2-fffe787f3be2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:23.317486 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ea0110e1-ca04-4990-bfe2-fffe787f3be2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:23.317929 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ea0110e1-ca04-4990-bfe2-fffe787f3be2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:23.318725 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ea0110e1-ca04-4990-bfe2-fffe787f3be2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:23.319114 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ea0110e1-ca04-4990-bfe2-fffe787f3be2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:23.509827 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ea0110e1-ca04-4990-bfe2-fffe787f3be2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:23.518962 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ea0110e1-ca04-4990-bfe2-fffe787f3be2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.213398 May 27 09:51:23.529649 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 540/1082] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:23 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:23.723004 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-f782ee58-1145-4fd7-8c17-16658e0b0e22 req-3d8edb9b-4f61-40f9-88e8-e86daae3e8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e13117-8fb3-47ff-86e7-79d912a1482b", "tag": "26f605f8-7eb5-4baa-801a-abfbce1e6b77"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:51:23.752727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-f782ee58-1145-4fd7-8c17-16658e0b0e22 req-3d8edb9b-4f61-40f9-88e8-e86daae3e8d2 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:23.753542 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-f782ee58-1145-4fd7-8c17-16658e0b0e22 req-3d8edb9b-4f61-40f9-88e8-e86daae3e8d2 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:23.768076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-f782ee58-1145-4fd7-8c17-16658e0b0e22 req-3d8edb9b-4f61-40f9-88e8-e86daae3e8d2 service nova] Creating event network-changed:26f605f8-7eb5-4baa-801a-abfbce1e6b77 for instance d0e13117-8fb3-47ff-86e7-79d912a1482b on hv-cinder-79760 May 27 09:51:23.773587 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-f782ee58-1145-4fd7-8c17-16658e0b0e22 req-3d8edb9b-4f61-40f9-88e8-e86daae3e8d2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056849 May 27 09:51:23.775036 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 543/1083] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:51:24.536176 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-04a2b674-a3e9-4ec3-b523-11e8f8f2c6de tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:24.536801 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-04a2b674-a3e9-4ec3-b523-11e8f8f2c6de tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:24.545070 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-04a2b674-a3e9-4ec3-b523-11e8f8f2c6de tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:24.545868 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-04a2b674-a3e9-4ec3-b523-11e8f8f2c6de tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:24.547219 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-04a2b674-a3e9-4ec3-b523-11e8f8f2c6de tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:24.547993 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-04a2b674-a3e9-4ec3-b523-11e8f8f2c6de tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:24.681286 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-04a2b674-a3e9-4ec3-b523-11e8f8f2c6de tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:24.688826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-04a2b674-a3e9-4ec3-b523-11e8f8f2c6de tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.156574 May 27 09:51:24.689396 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 541/1084] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:24 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:25.707143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-abac22cf-8e50-4992-912d-ce669ecbe7fc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:25.707872 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-abac22cf-8e50-4992-912d-ce669ecbe7fc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:25.714800 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-abac22cf-8e50-4992-912d-ce669ecbe7fc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:25.715248 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-abac22cf-8e50-4992-912d-ce669ecbe7fc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:25.716263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-abac22cf-8e50-4992-912d-ce669ecbe7fc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:25.716702 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-abac22cf-8e50-4992-912d-ce669ecbe7fc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:25.863302 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-abac22cf-8e50-4992-912d-ce669ecbe7fc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:25.871161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-abac22cf-8e50-4992-912d-ce669ecbe7fc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.168908 May 27 09:51:25.871775 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 544/1085] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:25 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:26.887930 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-eb20116f-9f59-4cd5-9bcc-8671744306ca tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:26.888531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-eb20116f-9f59-4cd5-9bcc-8671744306ca tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:26.894531 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eb20116f-9f59-4cd5-9bcc-8671744306ca tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:26.894972 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eb20116f-9f59-4cd5-9bcc-8671744306ca tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:26.895759 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eb20116f-9f59-4cd5-9bcc-8671744306ca tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:26.896188 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eb20116f-9f59-4cd5-9bcc-8671744306ca tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:27.026114 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-eb20116f-9f59-4cd5-9bcc-8671744306ca tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:27.033439 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-eb20116f-9f59-4cd5-9bcc-8671744306ca tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.149337 May 27 09:51:27.034138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 542/1086] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:26 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:28.052207 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bd50f855-8592-4d04-bd88-38c2742d103c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:28.052833 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bd50f855-8592-4d04-bd88-38c2742d103c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:28.060189 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd50f855-8592-4d04-bd88-38c2742d103c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:28.060740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd50f855-8592-4d04-bd88-38c2742d103c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:28.067320 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd50f855-8592-4d04-bd88-38c2742d103c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:28.067791 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bd50f855-8592-4d04-bd88-38c2742d103c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:28.225031 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bd50f855-8592-4d04-bd88-38c2742d103c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:28.232805 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bd50f855-8592-4d04-bd88-38c2742d103c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.186423 May 27 09:51:28.233456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 545/1087] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:28 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:29.249631 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-239b7bba-0c8c-4eeb-af74-82233d67bf64 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:29.250255 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-239b7bba-0c8c-4eeb-af74-82233d67bf64 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:29.257246 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-239b7bba-0c8c-4eeb-af74-82233d67bf64 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:29.257709 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-239b7bba-0c8c-4eeb-af74-82233d67bf64 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:29.258474 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-239b7bba-0c8c-4eeb-af74-82233d67bf64 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:29.258918 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-239b7bba-0c8c-4eeb-af74-82233d67bf64 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:29.395217 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-239b7bba-0c8c-4eeb-af74-82233d67bf64 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:29.402771 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-239b7bba-0c8c-4eeb-af74-82233d67bf64 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.156991 May 27 09:51:29.403357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 543/1088] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:29 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:30.419915 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e01bffef-6077-4824-823f-23061889dfc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:30.420527 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e01bffef-6077-4824-823f-23061889dfc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:30.426879 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e01bffef-6077-4824-823f-23061889dfc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:30.427365 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e01bffef-6077-4824-823f-23061889dfc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:30.428137 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e01bffef-6077-4824-823f-23061889dfc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:30.428577 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e01bffef-6077-4824-823f-23061889dfc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:30.566469 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e01bffef-6077-4824-823f-23061889dfc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:30.574467 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e01bffef-6077-4824-823f-23061889dfc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.159054 May 27 09:51:30.575031 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 546/1089] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:30 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:31.591734 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-86be6fc1-eabe-4975-b140-6d431f63667e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:31.592361 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-86be6fc1-eabe-4975-b140-6d431f63667e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:31.594672 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:31.600223 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-86be6fc1-eabe-4975-b140-6d431f63667e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:31.600684 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-86be6fc1-eabe-4975-b140-6d431f63667e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:31.601465 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-86be6fc1-eabe-4975-b140-6d431f63667e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:31.601904 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-86be6fc1-eabe-4975-b140-6d431f63667e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:31.734759 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-86be6fc1-eabe-4975-b140-6d431f63667e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:31.742321 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-86be6fc1-eabe-4975-b140-6d431f63667e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.155149 May 27 09:51:31.742897 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 544/1090] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:31 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:51:32.759206 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c262fcd7-1e94-40d7-8d34-dac2aa0334e6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:32.759832 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c262fcd7-1e94-40d7-8d34-dac2aa0334e6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:32.761753 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:32.762403 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=6 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:32.768938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c262fcd7-1e94-40d7-8d34-dac2aa0334e6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:32.769379 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c262fcd7-1e94-40d7-8d34-dac2aa0334e6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:32.770140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c262fcd7-1e94-40d7-8d34-dac2aa0334e6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:32.770572 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c262fcd7-1e94-40d7-8d34-dac2aa0334e6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:32.906282 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c262fcd7-1e94-40d7-8d34-dac2aa0334e6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:32.914308 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c262fcd7-1e94-40d7-8d34-dac2aa0334e6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.159077 May 27 09:51:32.915091 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 547/1091] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:32 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:33.931492 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-62d0a647-e061-4c4c-8f86-7bcf36eefb89 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:33.932102 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-62d0a647-e061-4c4c-8f86-7bcf36eefb89 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:33.938485 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62d0a647-e061-4c4c-8f86-7bcf36eefb89 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:33.938942 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62d0a647-e061-4c4c-8f86-7bcf36eefb89 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:33.939743 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62d0a647-e061-4c4c-8f86-7bcf36eefb89 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:33.940187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-62d0a647-e061-4c4c-8f86-7bcf36eefb89 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:33.949854 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-8a1943e4-212b-4ff2-b3c6-67d7009cdbd7 req-6fcd6a38-ff1f-42bb-9e2d-d0fbc22af9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e13117-8fb3-47ff-86e7-79d912a1482b", "name": "network-vif-plugged", "status": "completed", "tag": "26f605f8-7eb5-4baa-801a-abfbce1e6b77"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:51:33.958484 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-8a1943e4-212b-4ff2-b3c6-67d7009cdbd7 req-6fcd6a38-ff1f-42bb-9e2d-d0fbc22af9fc service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:33.958904 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-8a1943e4-212b-4ff2-b3c6-67d7009cdbd7 req-6fcd6a38-ff1f-42bb-9e2d-d0fbc22af9fc service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:33.976120 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-8a1943e4-212b-4ff2-b3c6-67d7009cdbd7 req-6fcd6a38-ff1f-42bb-9e2d-d0fbc22af9fc service nova] Creating event network-vif-plugged:26f605f8-7eb5-4baa-801a-abfbce1e6b77 for instance d0e13117-8fb3-47ff-86e7-79d912a1482b on hv-cinder-79760 May 27 09:51:33.981340 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-8a1943e4-212b-4ff2-b3c6-67d7009cdbd7 req-6fcd6a38-ff1f-42bb-9e2d-d0fbc22af9fc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036487 May 27 09:51:33.982449 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 548/1092] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:51:34.093720 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-62d0a647-e061-4c4c-8f86-7bcf36eefb89 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:34.101110 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-62d0a647-e061-4c4c-8f86-7bcf36eefb89 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.173518 May 27 09:51:34.101674 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 545/1093] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:33 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:35.118894 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-eb3ac526-ccb5-45b9-afe6-67ac7f63156b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:35.119618 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-eb3ac526-ccb5-45b9-afe6-67ac7f63156b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:35.126131 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eb3ac526-ccb5-45b9-afe6-67ac7f63156b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:35.126582 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eb3ac526-ccb5-45b9-afe6-67ac7f63156b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:35.127392 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eb3ac526-ccb5-45b9-afe6-67ac7f63156b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:35.127831 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-eb3ac526-ccb5-45b9-afe6-67ac7f63156b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:35.260143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-eb3ac526-ccb5-45b9-afe6-67ac7f63156b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:35.267695 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-eb3ac526-ccb5-45b9-afe6-67ac7f63156b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1265 microversion: 2.1 time: 0.153416 May 27 09:51:35.268276 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 549/1094] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:35 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:36.285942 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-31e0b121-09f0-4422-bc49-af5e7c3d231d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:36.286629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-31e0b121-09f0-4422-bc49-af5e7c3d231d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:36.294610 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-31e0b121-09f0-4422-bc49-af5e7c3d231d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:36.295071 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-31e0b121-09f0-4422-bc49-af5e7c3d231d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:36.296030 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-31e0b121-09f0-4422-bc49-af5e7c3d231d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:36.296478 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-31e0b121-09f0-4422-bc49-af5e7c3d231d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:36.429875 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-31e0b121-09f0-4422-bc49-af5e7c3d231d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:36.438320 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-31e0b121-09f0-4422-bc49-af5e7c3d231d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1452 microversion: 2.1 time: 0.156391 May 27 09:51:36.438917 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 546/1095] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:36 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:36.454342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e74abc71-4716-436e-b8ef-6b95877cbcd8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:36.454954 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e74abc71-4716-436e-b8ef-6b95877cbcd8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:36.461714 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e74abc71-4716-436e-b8ef-6b95877cbcd8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:36.462285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e74abc71-4716-436e-b8ef-6b95877cbcd8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:36.463053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e74abc71-4716-436e-b8ef-6b95877cbcd8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:36.464501 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e74abc71-4716-436e-b8ef-6b95877cbcd8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:36.606038 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-e74abc71-4716-436e-b8ef-6b95877cbcd8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:36.613642 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e74abc71-4716-436e-b8ef-6b95877cbcd8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1452 microversion: 2.1 time: 0.163068 May 27 09:51:36.614215 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 550/1096] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:51:36 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:38.632722 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-9b18fe00-076d-4989-adcc-01edc5b96c50 req-21d34a98-7cfd-4744-9076-4a231a868fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0e13117-8fb3-47ff-86e7-79d912a1482b", "tag": "26f605f8-7eb5-4baa-801a-abfbce1e6b77"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:51:38.644673 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-9b18fe00-076d-4989-adcc-01edc5b96c50 req-21d34a98-7cfd-4744-9076-4a231a868fbb service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:38.645116 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-9b18fe00-076d-4989-adcc-01edc5b96c50 req-21d34a98-7cfd-4744-9076-4a231a868fbb service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:38.656879 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-9b18fe00-076d-4989-adcc-01edc5b96c50 req-21d34a98-7cfd-4744-9076-4a231a868fbb service nova] Creating event network-changed:26f605f8-7eb5-4baa-801a-abfbce1e6b77 for instance d0e13117-8fb3-47ff-86e7-79d912a1482b on hv-cinder-79760 May 27 09:51:38.662175 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-9b18fe00-076d-4989-adcc-01edc5b96c50 req-21d34a98-7cfd-4744-9076-4a231a868fbb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033136 May 27 09:51:38.662768 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 547/1097] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:52:10.029513 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7bf78b30-9422-460c-b52b-08ff8bb9f213 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:10.030121 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7bf78b30-9422-460c-b52b-08ff8bb9f213 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:10.032149 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:10.032802 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=48 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:10.039137 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7bf78b30-9422-460c-b52b-08ff8bb9f213 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:10.039616 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7bf78b30-9422-460c-b52b-08ff8bb9f213 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:10.040392 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7bf78b30-9422-460c-b52b-08ff8bb9f213 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:10.040826 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7bf78b30-9422-460c-b52b-08ff8bb9f213 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:10.064036 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7bf78b30-9422-460c-b52b-08ff8bb9f213 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1/ips" status: 200 len: 150 microversion: 2.1 time: 0.039146 May 27 09:52:10.064635 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 551/1098] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 09:52:10 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:10.072682 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=20 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:10.073423 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=44 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:10.078161 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-eda3986a-0ee8-4acc-b8a8-de2ecd0680b2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaa5742f-04d6-4309-84c5-153a2a70f221"}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:10.079316 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-eda3986a-0ee8-4acc-b8a8-de2ecd0680b2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:10.086190 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eda3986a-0ee8-4acc-b8a8-de2ecd0680b2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:10.086639 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eda3986a-0ee8-4acc-b8a8-de2ecd0680b2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:10.087424 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eda3986a-0ee8-4acc-b8a8-de2ecd0680b2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:10.087862 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-eda3986a-0ee8-4acc-b8a8-de2ecd0680b2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:10.166039 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-eda3986a-0ee8-4acc-b8a8-de2ecd0680b2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Invalid volume: volume aaa5742f-04d6-4309-84c5-153a2a70f221 is already attached to instances: 2e2f121d-c06c-46e0-9e8b-455c50a5866f May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-eda3986a-0ee8-4acc-b8a8-de2ecd0680b2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: POST /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1/os-volume_attachments HTTP/1.1 May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 74 May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:52:10.167947 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {"volumeAttachment": {"volumeId": "aaa5742f-04d6-4309-84c5-153a2a70f221"}} May 27 09:52:10.169656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Invalid volume: volume aaa5742f-04d6-4309-84c5-153a2a70f221 is already attached to instances: 2e2f121d-c06c-46e0-9e8b-455c50a5866f May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'server_id': '1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1', 'body': {'volumeAttachment': {'volumeId': 'aaa5742f-04d6-4309-84c5-153a2a70f221'}}} May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aaa5742f-04d6-4309-84c5-153a2a70f221 is already attached to instances: 2e2f121d-c06c-46e0-9e8b-455c50a5866f May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:52:10.170727 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aaa5742f-04d6-4309-84c5-153a2a70f221 is already attached to instances: 2e2f121d-c06c-46e0-9e8b-455c50a5866f May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:10.172292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:52:10.174004 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:52:10.174004 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:52:10.174004 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:52:10.174004 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aaa5742f-04d6-4309-84c5-153a2a70f221 is already attached to instances: 2e2f121d-c06c-46e0-9e8b-455c50a5866f May 27 09:52:10.174004 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:52:10.174004 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-eda3986a-0ee8-4acc-b8a8-de2ecd0680b2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 400 to user: Invalid volume: volume aaa5742f-04d6-4309-84c5-153a2a70f221 is already attached to instances: 2e2f121d-c06c-46e0-9e8b-455c50a5866f {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:52:10.174004 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-eda3986a-0ee8-4acc-b8a8-de2ecd0680b2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098347 May 27 09:52:10.174004 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 548/1099] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:52:10 2022] POST /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 09:52:10.177918 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-381b1ea8-d8bb-45e8-a358-c1f91a6cb358 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:10.178450 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-381b1ea8-d8bb-45e8-a358-c1f91a6cb358 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:10.185064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-381b1ea8-d8bb-45e8-a358-c1f91a6cb358 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:10.185515 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-381b1ea8-d8bb-45e8-a358-c1f91a6cb358 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:10.186285 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-381b1ea8-d8bb-45e8-a358-c1f91a6cb358 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:10.186728 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-381b1ea8-d8bb-45e8-a358-c1f91a6cb358 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:10.211486 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-381b1ea8-d8bb-45e8-a358-c1f91a6cb358 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Going to try to terminate instance {{(pid=129290) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:52:10.285315 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-381b1ea8-d8bb-45e8-a358-c1f91a6cb358 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 204 len: 0 microversion: 2.1 time: 0.110716 May 27 09:52:10.286202 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 552/1100] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:52:10 2022] DELETE /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:52:10.294926 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f3fe0fbe-2e85-4dcc-a9a0-4e3f01e23799 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:10.295560 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f3fe0fbe-2e85-4dcc-a9a0-4e3f01e23799 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:10.302249 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3fe0fbe-2e85-4dcc-a9a0-4e3f01e23799 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:10.302689 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3fe0fbe-2e85-4dcc-a9a0-4e3f01e23799 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:10.303534 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3fe0fbe-2e85-4dcc-a9a0-4e3f01e23799 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:10.303998 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3fe0fbe-2e85-4dcc-a9a0-4e3f01e23799 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:10.434176 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f3fe0fbe-2e85-4dcc-a9a0-4e3f01e23799 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:10.441502 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f3fe0fbe-2e85-4dcc-a9a0-4e3f01e23799 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1682 microversion: 2.1 time: 0.150732 May 27 09:52:10.442068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 549/1101] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:10 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:11.460232 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-51aa7382-7b3e-48c2-b0b9-40cdf39e18a2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:11.460938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-51aa7382-7b3e-48c2-b0b9-40cdf39e18a2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:11.468384 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-51aa7382-7b3e-48c2-b0b9-40cdf39e18a2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:11.468849 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-51aa7382-7b3e-48c2-b0b9-40cdf39e18a2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:11.469621 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-51aa7382-7b3e-48c2-b0b9-40cdf39e18a2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:11.470060 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-51aa7382-7b3e-48c2-b0b9-40cdf39e18a2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:11.599695 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-51aa7382-7b3e-48c2-b0b9-40cdf39e18a2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:11.607159 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-51aa7382-7b3e-48c2-b0b9-40cdf39e18a2 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1682 microversion: 2.1 time: 0.151166 May 27 09:52:11.607857 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 553/1102] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:11 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:12.624269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-25a99d0d-71f3-432f-a412-e496e969bc22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:12.624886 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-25a99d0d-71f3-432f-a412-e496e969bc22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:12.631315 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-25a99d0d-71f3-432f-a412-e496e969bc22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:12.631793 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-25a99d0d-71f3-432f-a412-e496e969bc22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:12.632557 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-25a99d0d-71f3-432f-a412-e496e969bc22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:12.632992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-25a99d0d-71f3-432f-a412-e496e969bc22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:12.702558 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-25a99d0d-71f3-432f-a412-e496e969bc22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:12.710006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-25a99d0d-71f3-432f-a412-e496e969bc22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 200 len: 1614 microversion: 2.1 time: 0.089729 May 27 09:52:12.710580 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 550/1103] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:12 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:12.797334 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-33637838-c70d-4dc4-b4b5-33d767128ea8 req-ddc419ab-c58d-4752-a98b-14f4a3315f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1", "name": "network-vif-deleted", "tag": "2b4e04f6-70c5-40ba-9aca-55eb635f816e"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:12.806523 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-33637838-c70d-4dc4-b4b5-33d767128ea8 req-ddc419ab-c58d-4752-a98b-14f4a3315f50 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:12.806971 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-33637838-c70d-4dc4-b4b5-33d767128ea8 req-ddc419ab-c58d-4752-a98b-14f4a3315f50 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:12.819045 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-33637838-c70d-4dc4-b4b5-33d767128ea8 req-ddc419ab-c58d-4752-a98b-14f4a3315f50 service nova] Creating event network-vif-deleted:2b4e04f6-70c5-40ba-9aca-55eb635f816e for instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 on hv-cinder-79760 May 27 09:52:12.825394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-33637838-c70d-4dc4-b4b5-33d767128ea8 req-ddc419ab-c58d-4752-a98b-14f4a3315f50 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032309 May 27 09:52:12.826341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 554/1104] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:13.478797 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:52:13.479063 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Fri May 27 09:52:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:52:13.727881 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e617fb21-34ef-4917-b86c-5f6ca9d6c94e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:13.728524 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e617fb21-34ef-4917-b86c-5f6ca9d6c94e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:13.734914 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e617fb21-34ef-4917-b86c-5f6ca9d6c94e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:13.735392 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e617fb21-34ef-4917-b86c-5f6ca9d6c94e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:13.736180 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e617fb21-34ef-4917-b86c-5f6ca9d6c94e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:13.736610 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e617fb21-34ef-4917-b86c-5f6ca9d6c94e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:13.749755 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-e617fb21-34ef-4917-b86c-5f6ca9d6c94e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e617fb21-34ef-4917-b86c-5f6ca9d6c94e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 HTTP/1.1 May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:52:13.751295 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:52:13.752784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1'} May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:52:13.753556 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:52:13.754863 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:52:13.756802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e617fb21-34ef-4917-b86c-5f6ca9d6c94e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:52:13.756802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e617fb21-34ef-4917-b86c-5f6ca9d6c94e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 404 len: 111 microversion: 2.1 time: 0.028698 May 27 09:52:13.756802 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 551/1105] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:13 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:52:13.762469 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2df038e4-40f4-439c-a489-787327cb6b2d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '.version_select at 0x7f188c095f70>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:13.781386 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2df038e4-40f4-439c-a489-787327cb6b2d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-417833115" status: 202 len: 0 microversion: 2.1 time: 0.023136 May 27 09:52:13.781943 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 555/1106] 10.222.0.41 () {58 vars in 1217 bytes} [Fri May 27 09:52:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-417833115 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:52:14.430710 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6c3a49e5-54b2-4a19-926c-1371c3767a0b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:14.431207 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6c3a49e5-54b2-4a19-926c-1371c3767a0b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:14.437811 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6c3a49e5-54b2-4a19-926c-1371c3767a0b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:14.438262 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6c3a49e5-54b2-4a19-926c-1371c3767a0b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:14.439021 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6c3a49e5-54b2-4a19-926c-1371c3767a0b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:14.439495 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6c3a49e5-54b2-4a19-926c-1371c3767a0b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:14.519496 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-6c3a49e5-54b2-4a19-926c-1371c3767a0b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lazy-loading 'services' on Instance uuid 2e2f121d-c06c-46e0-9e8b-455c50a5866f {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:52:14.588618 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6c3a49e5-54b2-4a19-926c-1371c3767a0b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments/aaa5742f-04d6-4309-84c5-153a2a70f221" status: 202 len: 0 microversion: 2.1 time: 0.161351 May 27 09:52:14.589257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 552/1107] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:52:14 2022] DELETE /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments/aaa5742f-04d6-4309-84c5-153a2a70f221 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:52:14.598058 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-def1ae98-c29b-4cac-ba79-cbd6d39b9892 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:14.599243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-def1ae98-c29b-4cac-ba79-cbd6d39b9892 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:14.606577 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-def1ae98-c29b-4cac-ba79-cbd6d39b9892 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:14.607032 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-def1ae98-c29b-4cac-ba79-cbd6d39b9892 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:14.607962 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-def1ae98-c29b-4cac-ba79-cbd6d39b9892 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:14.608628 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-def1ae98-c29b-4cac-ba79-cbd6d39b9892 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:14.639668 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-def1ae98-c29b-4cac-ba79-cbd6d39b9892 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045971 May 27 09:52:14.640388 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 556/1108] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:52:14 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:15.653033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-cb8dd072-a7af-45fc-80cf-4dab1d7b03cd tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:15.654010 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-cb8dd072-a7af-45fc-80cf-4dab1d7b03cd tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:15.660251 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb8dd072-a7af-45fc-80cf-4dab1d7b03cd tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:15.660711 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb8dd072-a7af-45fc-80cf-4dab1d7b03cd tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:15.661476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb8dd072-a7af-45fc-80cf-4dab1d7b03cd tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:15.661917 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-cb8dd072-a7af-45fc-80cf-4dab1d7b03cd tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:15.693574 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-cb8dd072-a7af-45fc-80cf-4dab1d7b03cd tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045885 May 27 09:52:15.694136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 553/1109] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:52:15 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:16.705187 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f53fde1b-89cc-4784-aaeb-2cdb3481a46c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:16.706025 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f53fde1b-89cc-4784-aaeb-2cdb3481a46c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:16.712165 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f53fde1b-89cc-4784-aaeb-2cdb3481a46c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:16.712614 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f53fde1b-89cc-4784-aaeb-2cdb3481a46c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:16.713634 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f53fde1b-89cc-4784-aaeb-2cdb3481a46c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:16.714063 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f53fde1b-89cc-4784-aaeb-2cdb3481a46c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:16.742468 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f53fde1b-89cc-4784-aaeb-2cdb3481a46c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041283 May 27 09:52:16.743012 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 557/1110] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:52:16 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:17.754824 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-2b0e9681-f631-4389-8c04-fcf8a656eb30 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:17.755696 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-2b0e9681-f631-4389-8c04-fcf8a656eb30 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:17.762745 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2b0e9681-f631-4389-8c04-fcf8a656eb30 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:17.763199 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2b0e9681-f631-4389-8c04-fcf8a656eb30 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:17.763992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2b0e9681-f631-4389-8c04-fcf8a656eb30 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:17.764440 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-2b0e9681-f631-4389-8c04-fcf8a656eb30 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:17.793592 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-2b0e9681-f631-4389-8c04-fcf8a656eb30 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042859 May 27 09:52:17.794155 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 554/1111] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:52:17 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:18.805090 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-629e72e6-e2aa-421b-a88a-2150ed14cc7e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:18.806049 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-629e72e6-e2aa-421b-a88a-2150ed14cc7e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:18.813128 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-629e72e6-e2aa-421b-a88a-2150ed14cc7e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:18.813573 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-629e72e6-e2aa-421b-a88a-2150ed14cc7e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:18.814335 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-629e72e6-e2aa-421b-a88a-2150ed14cc7e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:18.814771 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-629e72e6-e2aa-421b-a88a-2150ed14cc7e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:18.844039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-629e72e6-e2aa-421b-a88a-2150ed14cc7e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042904 May 27 09:52:18.844582 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 558/1112] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:52:18 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:19.855229 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c2b737c8-962e-4362-be9a-a233710899f5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:19.856164 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c2b737c8-962e-4362-be9a-a233710899f5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:19.862547 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c2b737c8-962e-4362-be9a-a233710899f5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:19.862988 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c2b737c8-962e-4362-be9a-a233710899f5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:19.863777 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c2b737c8-962e-4362-be9a-a233710899f5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:19.864207 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c2b737c8-962e-4362-be9a-a233710899f5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:19.892817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c2b737c8-962e-4362-be9a-a233710899f5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041576 May 27 09:52:19.893370 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 555/1113] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:52:19 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:20.903998 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-61442f6f-c170-41b9-8feb-7c504a4d3a5e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:20.904907 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-61442f6f-c170-41b9-8feb-7c504a4d3a5e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:20.911496 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-61442f6f-c170-41b9-8feb-7c504a4d3a5e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:20.911941 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-61442f6f-c170-41b9-8feb-7c504a4d3a5e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:20.912699 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-61442f6f-c170-41b9-8feb-7c504a4d3a5e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:20.913129 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-61442f6f-c170-41b9-8feb-7c504a4d3a5e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:20.941273 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-61442f6f-c170-41b9-8feb-7c504a4d3a5e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041762 May 27 09:52:20.941812 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 559/1114] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:52:20 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:52:20.998145 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a5ca82fd-8e72-43de-ace7-ff4bafa6a312 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:20.998657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a5ca82fd-8e72-43de-ace7-ff4bafa6a312 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:21.005180 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a5ca82fd-8e72-43de-ace7-ff4bafa6a312 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:21.005630 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a5ca82fd-8e72-43de-ace7-ff4bafa6a312 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:21.006388 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a5ca82fd-8e72-43de-ace7-ff4bafa6a312 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:21.006817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a5ca82fd-8e72-43de-ace7-ff4bafa6a312 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:21.031545 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a5ca82fd-8e72-43de-ace7-ff4bafa6a312 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:52:21.105843 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a5ca82fd-8e72-43de-ace7-ff4bafa6a312 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 204 len: 0 microversion: 2.1 time: 0.111249 May 27 09:52:21.106434 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 556/1115] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:52:20 2022] DELETE /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:52:21.114750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-f9bb0fb9-eeee-4f52-a958-be0c65db5d3a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:21.115390 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-f9bb0fb9-eeee-4f52-a958-be0c65db5d3a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:21.121271 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f9bb0fb9-eeee-4f52-a958-be0c65db5d3a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:21.121719 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f9bb0fb9-eeee-4f52-a958-be0c65db5d3a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:21.122496 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f9bb0fb9-eeee-4f52-a958-be0c65db5d3a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:21.122915 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-f9bb0fb9-eeee-4f52-a958-be0c65db5d3a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:21.252157 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-f9bb0fb9-eeee-4f52-a958-be0c65db5d3a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:21.259491 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-f9bb0fb9-eeee-4f52-a958-be0c65db5d3a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1680 microversion: 2.1 time: 0.148515 May 27 09:52:21.260052 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 560/1116] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:21 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:22.278403 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-30704f19-16b0-4dbd-a24e-eeae54470412 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:22.279102 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-30704f19-16b0-4dbd-a24e-eeae54470412 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:22.285591 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30704f19-16b0-4dbd-a24e-eeae54470412 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:22.286051 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30704f19-16b0-4dbd-a24e-eeae54470412 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:22.286829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30704f19-16b0-4dbd-a24e-eeae54470412 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:22.287287 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-30704f19-16b0-4dbd-a24e-eeae54470412 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:22.420312 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-30704f19-16b0-4dbd-a24e-eeae54470412 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:22.427747 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-30704f19-16b0-4dbd-a24e-eeae54470412 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1680 microversion: 2.1 time: 0.154120 May 27 09:52:22.428310 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 557/1117] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:22 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:23.444689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-999697b8-7d78-4b03-a5db-79601e53b86e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:23.445402 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-999697b8-7d78-4b03-a5db-79601e53b86e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:23.451993 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-999697b8-7d78-4b03-a5db-79601e53b86e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:23.452536 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-999697b8-7d78-4b03-a5db-79601e53b86e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:23.453361 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-999697b8-7d78-4b03-a5db-79601e53b86e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:23.453858 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-999697b8-7d78-4b03-a5db-79601e53b86e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:23.695994 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-999697b8-7d78-4b03-a5db-79601e53b86e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:23.703971 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-999697b8-7d78-4b03-a5db-79601e53b86e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 200 len: 1680 microversion: 2.1 time: 0.263063 May 27 09:52:23.704567 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 561/1118] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:23 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 1680 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:24.078274 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-ff384629-268f-4d20-b392-aa07d4d24804 req-cb11a88f-8070-47ed-a899-74b0a4051f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2f121d-c06c-46e0-9e8b-455c50a5866f", "name": "network-vif-deleted", "tag": "20d830c8-49a4-4ca7-8971-22159d9bd480"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:24.087415 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-ff384629-268f-4d20-b392-aa07d4d24804 req-cb11a88f-8070-47ed-a899-74b0a4051f14 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:24.088485 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-ff384629-268f-4d20-b392-aa07d4d24804 req-cb11a88f-8070-47ed-a899-74b0a4051f14 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:24.100897 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-ff384629-268f-4d20-b392-aa07d4d24804 req-cb11a88f-8070-47ed-a899-74b0a4051f14 service nova] Creating event network-vif-deleted:20d830c8-49a4-4ca7-8971-22159d9bd480 for instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f on hv-cinder-79760 May 27 09:52:24.106896 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-ff384629-268f-4d20-b392-aa07d4d24804 req-cb11a88f-8070-47ed-a899-74b0a4051f14 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 May 27 09:52:24.107588 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 558/1119] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:24.722192 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0704cc30-0bbc-4192-ab74-0dc79a991b7d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:24.722779 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0704cc30-0bbc-4192-ab74-0dc79a991b7d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:24.729337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0704cc30-0bbc-4192-ab74-0dc79a991b7d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:24.729782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0704cc30-0bbc-4192-ab74-0dc79a991b7d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:24.731182 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0704cc30-0bbc-4192-ab74-0dc79a991b7d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:24.731637 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0704cc30-0bbc-4192-ab74-0dc79a991b7d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:24.744999 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-0704cc30-0bbc-4192-ab74-0dc79a991b7d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0704cc30-0bbc-4192-ab74-0dc79a991b7d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f HTTP/1.1 May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:52:24.746632 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:52:24.748317 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '2e2f121d-c06c-46e0-9e8b-455c50a5866f'} May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:52:24.749558 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:52:24.750903 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:52:24.753199 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0704cc30-0bbc-4192-ab74-0dc79a991b7d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:52:24.753199 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0704cc30-0bbc-4192-ab74-0dc79a991b7d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 404 len: 111 microversion: 2.1 time: 0.029829 May 27 09:52:24.753199 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 562/1120] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:24 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:52:24.757562 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f5fd380b-0d51-4cd0-acb5-8ecc380c823f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '.version_select at 0x7f1890b87ca0>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:24.774656 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f5fd380b-0d51-4cd0-acb5-8ecc380c823f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767861587" status: 202 len: 0 microversion: 2.1 time: 0.021198 May 27 09:52:24.775230 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 559/1121] 10.222.0.41 () {58 vars in 1220 bytes} [Fri May 27 09:52:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767861587 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:52:25.420040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2599ceea-6b4a-4eca-bcf7-d862e4ebbe0f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: .version_select at 0x7f188c545820>, body: {"keypair": {"name": "tempest-keypair-588651095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcxjjRHa31cNibbSHiIthpD3Pq+EWUSyBi6Q5Dvr7c2N/nnroeUYw33ntUMQRtE1JkaXj4kqzoyTouOhWvEKr4tGRZ3jVBESUXX8Pcf1ieiXn8TiFOXc+Hu5+sX0U1kvw=="}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:25.434326 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-2599ceea-6b4a-4eca-bcf7-d862e4ebbe0f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for project 43091208be574e6e8cc348667792f751. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:52:25.438068 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-2599ceea-6b4a-4eca-bcf7-d862e4ebbe0f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for user 8d96e9d955934f0e883df57a3bcf934d and project 43091208be574e6e8cc348667792f751. Resources: {'key_pairs'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:52:25.460063 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2599ceea-6b4a-4eca-bcf7-d862e4ebbe0f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043984 May 27 09:52:25.460638 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 563/1122] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 09:52:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:26.702559 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-714067799", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f851c882-debd-4ebe-9da5-a1c317e6e8ac"}], "security_groups": [{"name": "tempest-securitygroup--1354714358"}], "key_name": "tempest-keypair-588651095", "user_data": "}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:26.799543 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.network.neutron [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] validate_networks() for [('f851c882-debd-4ebe-9da5-a1c317e6e8ac', None, None, None, None, None)] {{(pid=129291) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:52:27.253461 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Flavor limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:52:27.253895 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Image limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:52:27.254374 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Flavor pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:52:27.254793 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Image pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:52:27.255204 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:52:27.264177 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:27.264626 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:27.265437 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:27.265877 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:27.282570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for project 43091208be574e6e8cc348667792f751. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:52:27.286553 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for user 8d96e9d955934f0e883df57a3bcf934d and project 43091208be574e6e8cc348667792f751. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:52:27.298064 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Going to run 1 instances... {{(pid=129291) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:52:27.300459 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:52:27.349650 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8161946a-a4a4-4b1a-977e-da8eeb54e60d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.652172 May 27 09:52:27.350298 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 560/1123] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:52:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:52:27.361475 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2f253b63-f38c-4acf-bed3-75fb8aaf582e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:27.362084 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2f253b63-f38c-4acf-bed3-75fb8aaf582e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:27.413908 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2f253b63-f38c-4acf-bed3-75fb8aaf582e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:27.421058 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2f253b63-f38c-4acf-bed3-75fb8aaf582e tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1240 microversion: 2.1 time: 0.063892 May 27 09:52:27.421623 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 564/1124] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:27 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:52:28.438192 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e4111752-ed60-4083-ac82-0cd4e0fffe28 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:28.438809 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e4111752-ed60-4083-ac82-0cd4e0fffe28 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:28.490126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-e4111752-ed60-4083-ac82-0cd4e0fffe28 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:28.499620 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e4111752-ed60-4083-ac82-0cd4e0fffe28 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1240 microversion: 2.1 time: 0.065384 May 27 09:52:28.500176 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 561/1125] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:28 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:29.516298 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-60530ac4-f1ec-40a9-9607-36f932751c17 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:29.517162 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-60530ac4-f1ec-40a9-9607-36f932751c17 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:29.568561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-60530ac4-f1ec-40a9-9607-36f932751c17 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:29.575215 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-60530ac4-f1ec-40a9-9607-36f932751c17 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1240 microversion: 2.1 time: 0.062894 May 27 09:52:29.575829 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 565/1126] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:29 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1240 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:30.592310 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6c3d8351-1c57-43b3-807e-854de451c5f4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:30.592914 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6c3d8351-1c57-43b3-807e-854de451c5f4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:30.648966 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-6c3d8351-1c57-43b3-807e-854de451c5f4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:30.655795 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6c3d8351-1c57-43b3-807e-854de451c5f4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1240 microversion: 2.1 time: 0.067636 May 27 09:52:30.656456 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 562/1127] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:30 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:52:31.672601 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ab01825a-b6c3-4966-afad-0e8d64dd2200 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:31.673144 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ab01825a-b6c3-4966-afad-0e8d64dd2200 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:31.681502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ab01825a-b6c3-4966-afad-0e8d64dd2200 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:31.681951 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ab01825a-b6c3-4966-afad-0e8d64dd2200 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:31.682714 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ab01825a-b6c3-4966-afad-0e8d64dd2200 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:31.683147 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ab01825a-b6c3-4966-afad-0e8d64dd2200 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:31.744729 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ab01825a-b6c3-4966-afad-0e8d64dd2200 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:31.751996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ab01825a-b6c3-4966-afad-0e8d64dd2200 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1244 microversion: 2.1 time: 0.083417 May 27 09:52:31.752571 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 566/1128] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:31 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:32.769200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f9529b81-a760-4484-8b7c-efdc1b597124 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:32.769815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f9529b81-a760-4484-8b7c-efdc1b597124 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:32.777825 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f9529b81-a760-4484-8b7c-efdc1b597124 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:32.778276 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f9529b81-a760-4484-8b7c-efdc1b597124 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:32.779034 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f9529b81-a760-4484-8b7c-efdc1b597124 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:32.779498 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f9529b81-a760-4484-8b7c-efdc1b597124 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:32.846317 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f9529b81-a760-4484-8b7c-efdc1b597124 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:32.853645 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f9529b81-a760-4484-8b7c-efdc1b597124 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1298 microversion: 2.1 time: 0.088273 May 27 09:52:32.854214 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 563/1129] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:32 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:33.872296 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2cdaae33-e91c-4f15-b92f-ae67d701d9ea tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:33.872968 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2cdaae33-e91c-4f15-b92f-ae67d701d9ea tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:33.880366 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2cdaae33-e91c-4f15-b92f-ae67d701d9ea tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:33.880839 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2cdaae33-e91c-4f15-b92f-ae67d701d9ea tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:33.881947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2cdaae33-e91c-4f15-b92f-ae67d701d9ea tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:33.882388 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2cdaae33-e91c-4f15-b92f-ae67d701d9ea tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:34.055858 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-3cd22223-4590-450e-ab55-7b92ad921616 req-b38a5a6a-5970-40d3-b6c8-abb998669307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "670d7a28-aa3d-47d5-aa4e-d5701879d778", "tag": "5f226c35-6541-4cc7-bf91-5784ae9faaa4"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:34.072306 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-3cd22223-4590-450e-ab55-7b92ad921616 req-b38a5a6a-5970-40d3-b6c8-abb998669307 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:34.072990 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-3cd22223-4590-450e-ab55-7b92ad921616 req-b38a5a6a-5970-40d3-b6c8-abb998669307 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:34.084525 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-3cd22223-4590-450e-ab55-7b92ad921616 req-b38a5a6a-5970-40d3-b6c8-abb998669307 service nova] Creating event network-changed:5f226c35-6541-4cc7-bf91-5784ae9faaa4 for instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 on hv-cinder-79760 May 27 09:52:34.090140 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-3cd22223-4590-450e-ab55-7b92ad921616 req-b38a5a6a-5970-40d3-b6c8-abb998669307 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037741 May 27 09:52:34.091396 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 564/1130] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:34.101209 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2cdaae33-e91c-4f15-b92f-ae67d701d9ea tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:34.110384 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2cdaae33-e91c-4f15-b92f-ae67d701d9ea tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1366 microversion: 2.1 time: 0.243664 May 27 09:52:34.111591 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 567/1131] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:33 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:35.128412 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fc7d820e-4ed0-4650-b243-d58c61eaca16 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:35.129139 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-fc7d820e-4ed0-4650-b243-d58c61eaca16 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:35.135660 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc7d820e-4ed0-4650-b243-d58c61eaca16 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:35.136778 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc7d820e-4ed0-4650-b243-d58c61eaca16 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:35.137548 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc7d820e-4ed0-4650-b243-d58c61eaca16 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:35.137989 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fc7d820e-4ed0-4650-b243-d58c61eaca16 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:35.263959 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-fc7d820e-4ed0-4650-b243-d58c61eaca16 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:35.271361 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fc7d820e-4ed0-4650-b243-d58c61eaca16 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1366 microversion: 2.1 time: 0.147566 May 27 09:52:35.271926 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 565/1132] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:35 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:36.287509 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bf43d150-75f0-4f03-b538-6e8ed27b5f90 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:36.288114 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-bf43d150-75f0-4f03-b538-6e8ed27b5f90 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:36.294497 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bf43d150-75f0-4f03-b538-6e8ed27b5f90 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:36.294939 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bf43d150-75f0-4f03-b538-6e8ed27b5f90 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:36.295712 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bf43d150-75f0-4f03-b538-6e8ed27b5f90 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:36.296143 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-bf43d150-75f0-4f03-b538-6e8ed27b5f90 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:36.428481 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-bf43d150-75f0-4f03-b538-6e8ed27b5f90 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:36.436537 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bf43d150-75f0-4f03-b538-6e8ed27b5f90 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1366 microversion: 2.1 time: 0.152919 May 27 09:52:36.437102 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 568/1133] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:36 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:37.453860 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b7d6e322-7bf3-43ac-b168-56fe772c238a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:37.454473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b7d6e322-7bf3-43ac-b168-56fe772c238a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:37.456591 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:37.461999 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b7d6e322-7bf3-43ac-b168-56fe772c238a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:37.462452 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b7d6e322-7bf3-43ac-b168-56fe772c238a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:37.463525 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b7d6e322-7bf3-43ac-b168-56fe772c238a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:37.463994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b7d6e322-7bf3-43ac-b168-56fe772c238a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:37.588760 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-b7d6e322-7bf3-43ac-b168-56fe772c238a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:37.596184 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b7d6e322-7bf3-43ac-b168-56fe772c238a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1366 microversion: 2.1 time: 0.146160 May 27 09:52:37.596751 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 566/1134] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:37 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:38.613401 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-850afb57-5698-4688-9f86-3819736a926c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:38.613948 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-850afb57-5698-4688-9f86-3819736a926c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:38.620414 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-850afb57-5698-4688-9f86-3819736a926c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:38.620858 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-850afb57-5698-4688-9f86-3819736a926c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:38.621616 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-850afb57-5698-4688-9f86-3819736a926c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:38.622077 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-850afb57-5698-4688-9f86-3819736a926c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:38.748255 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-850afb57-5698-4688-9f86-3819736a926c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:38.755752 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-850afb57-5698-4688-9f86-3819736a926c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1366 microversion: 2.1 time: 0.146224 May 27 09:52:38.756331 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 569/1135] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:38 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:39.773258 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-bc597519-69ee-4925-bc51-166bde706fc5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:39.773877 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-bc597519-69ee-4925-bc51-166bde706fc5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:39.780861 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bc597519-69ee-4925-bc51-166bde706fc5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:39.781313 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bc597519-69ee-4925-bc51-166bde706fc5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:39.782083 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bc597519-69ee-4925-bc51-166bde706fc5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:39.782523 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-bc597519-69ee-4925-bc51-166bde706fc5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:39.916285 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-bc597519-69ee-4925-bc51-166bde706fc5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:39.919693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:39.924955 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-bc597519-69ee-4925-bc51-166bde706fc5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1366 microversion: 2.1 time: 0.155544 May 27 09:52:39.925521 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 567/1136] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:39 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:40.285777 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-2b55f861-1923-47a5-96c6-319da7ffbc62 req-0c5fcca3-a92f-4d16-9370-31dedf06210d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670d7a28-aa3d-47d5-aa4e-d5701879d778", "name": "network-vif-plugged", "status": "completed", "tag": "5f226c35-6541-4cc7-bf91-5784ae9faaa4"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:40.289395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=8 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:40.290509 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:40.296417 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-2b55f861-1923-47a5-96c6-319da7ffbc62 req-0c5fcca3-a92f-4d16-9370-31dedf06210d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:40.296864 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-2b55f861-1923-47a5-96c6-319da7ffbc62 req-0c5fcca3-a92f-4d16-9370-31dedf06210d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:40.301237 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:40.309686 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-2b55f861-1923-47a5-96c6-319da7ffbc62 req-0c5fcca3-a92f-4d16-9370-31dedf06210d service nova] Creating event network-vif-plugged:5f226c35-6541-4cc7-bf91-5784ae9faaa4 for instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 on hv-cinder-79760 May 27 09:52:40.315016 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-2b55f861-1923-47a5-96c6-319da7ffbc62 req-0c5fcca3-a92f-4d16-9370-31dedf06210d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032935 May 27 09:52:40.315684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 570/1137] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:40.941788 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f3c1098e-c33a-4cd1-ac70-8ac82cfeb525 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:40.942315 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f3c1098e-c33a-4cd1-ac70-8ac82cfeb525 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:40.944696 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=10 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:40.946149 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:40.954012 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3c1098e-c33a-4cd1-ac70-8ac82cfeb525 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:40.954461 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3c1098e-c33a-4cd1-ac70-8ac82cfeb525 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:40.955238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3c1098e-c33a-4cd1-ac70-8ac82cfeb525 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:40.955708 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3c1098e-c33a-4cd1-ac70-8ac82cfeb525 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:41.086826 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f3c1098e-c33a-4cd1-ac70-8ac82cfeb525 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:41.094402 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f3c1098e-c33a-4cd1-ac70-8ac82cfeb525 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1366 microversion: 2.1 time: 0.156612 May 27 09:52:41.094965 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 568/1138] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:40 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:42.112145 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fab4b88d-fb38-432b-93f7-bb30fcff9f8b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:42.112937 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fab4b88d-fb38-432b-93f7-bb30fcff9f8b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:42.121485 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fab4b88d-fb38-432b-93f7-bb30fcff9f8b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:42.121889 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fab4b88d-fb38-432b-93f7-bb30fcff9f8b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:42.122638 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fab4b88d-fb38-432b-93f7-bb30fcff9f8b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:42.123070 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fab4b88d-fb38-432b-93f7-bb30fcff9f8b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:42.248501 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fab4b88d-fb38-432b-93f7-bb30fcff9f8b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:42.255938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fab4b88d-fb38-432b-93f7-bb30fcff9f8b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1555 microversion: 2.1 time: 0.148552 May 27 09:52:42.256504 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 571/1139] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:52:42 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:42.272376 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-61b59bb8-d349-4d7b-a808-1479f24ea2e7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:42.272851 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-61b59bb8-d349-4d7b-a808-1479f24ea2e7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:42.279829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-61b59bb8-d349-4d7b-a808-1479f24ea2e7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:42.280278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-61b59bb8-d349-4d7b-a808-1479f24ea2e7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:42.281033 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-61b59bb8-d349-4d7b-a808-1479f24ea2e7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:42.281503 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-61b59bb8-d349-4d7b-a808-1479f24ea2e7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:42.355804 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-61b59bb8-d349-4d7b-a808-1479f24ea2e7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087166 May 27 09:52:42.356404 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 569/1140] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 09:52:42 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:43.250847 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-5a3f88a3-e23b-4b25-8a82-84ea4f972a9b req-35e4cdfb-df9a-4ddb-8a9f-daf0796b4190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "670d7a28-aa3d-47d5-aa4e-d5701879d778", "tag": "5f226c35-6541-4cc7-bf91-5784ae9faaa4"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:43.259659 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-5a3f88a3-e23b-4b25-8a82-84ea4f972a9b req-35e4cdfb-df9a-4ddb-8a9f-daf0796b4190 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:43.260169 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-5a3f88a3-e23b-4b25-8a82-84ea4f972a9b req-35e4cdfb-df9a-4ddb-8a9f-daf0796b4190 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:43.270938 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-5a3f88a3-e23b-4b25-8a82-84ea4f972a9b req-35e4cdfb-df9a-4ddb-8a9f-daf0796b4190 service nova] Creating event network-changed:5f226c35-6541-4cc7-bf91-5784ae9faaa4 for instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 on hv-cinder-79760 May 27 09:52:43.275987 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-5a3f88a3-e23b-4b25-8a82-84ea4f972a9b req-35e4cdfb-df9a-4ddb-8a9f-daf0796b4190 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028739 May 27 09:52:43.277273 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 572/1141] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:53:58.200777 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:58.201541 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=10 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:58.342498 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b0e1cbff-21e5-49d8-b57e-0a17b8b21012 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:58.342995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-b0e1cbff-21e5-49d8-b57e-0a17b8b21012 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:58.348974 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b0e1cbff-21e5-49d8-b57e-0a17b8b21012 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:58.349423 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b0e1cbff-21e5-49d8-b57e-0a17b8b21012 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:58.350189 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b0e1cbff-21e5-49d8-b57e-0a17b8b21012 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:58.350624 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-b0e1cbff-21e5-49d8-b57e-0a17b8b21012 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:58.374988 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b0e1cbff-21e5-49d8-b57e-0a17b8b21012 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/ips" status: 200 len: 148 microversion: 2.1 time: 0.176158 May 27 09:53:58.375567 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 570/1142] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 09:53:58 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/ips => generated 148 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:53:59.695762 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=5 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:59.696559 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=9 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:59.701084 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-26adf95b-0471-42e7-bc38-2b5ba95a6e8d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f22892a4-db01-4021-90a8-5a44b711fb41"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:53:59.702218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-26adf95b-0471-42e7-bc38-2b5ba95a6e8d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:59.709132 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-26adf95b-0471-42e7-bc38-2b5ba95a6e8d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:59.709578 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-26adf95b-0471-42e7-bc38-2b5ba95a6e8d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:59.710336 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-26adf95b-0471-42e7-bc38-2b5ba95a6e8d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:59.710771 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-26adf95b-0471-42e7-bc38-2b5ba95a6e8d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:00.092685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-26adf95b-0471-42e7-bc38-2b5ba95a6e8d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.398654 May 27 09:54:00.093365 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 573/1143] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:53:59 2022] POST /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:06.311751 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a8319cf1-3f3e-4874-9269-279e0c27a55f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:06.312314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a8319cf1-3f3e-4874-9269-279e0c27a55f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:06.319200 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8319cf1-3f3e-4874-9269-279e0c27a55f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:06.319629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8319cf1-3f3e-4874-9269-279e0c27a55f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:06.320379 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8319cf1-3f3e-4874-9269-279e0c27a55f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:06.320814 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a8319cf1-3f3e-4874-9269-279e0c27a55f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:06.345682 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a8319cf1-3f3e-4874-9269-279e0c27a55f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:54:06.418865 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a8319cf1-3f3e-4874-9269-279e0c27a55f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 204 len: 0 microversion: 2.1 time: 0.110713 May 27 09:54:06.419442 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 571/1144] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:54:06 2022] DELETE /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:54:06.427980 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-cd2d28f0-64c3-4714-b2ac-2ed156c9d813 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:06.428740 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-cd2d28f0-64c3-4714-b2ac-2ed156c9d813 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:06.435156 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cd2d28f0-64c3-4714-b2ac-2ed156c9d813 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:06.435665 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cd2d28f0-64c3-4714-b2ac-2ed156c9d813 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:06.436430 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cd2d28f0-64c3-4714-b2ac-2ed156c9d813 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:06.436862 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cd2d28f0-64c3-4714-b2ac-2ed156c9d813 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:06.574191 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cd2d28f0-64c3-4714-b2ac-2ed156c9d813 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:06.581641 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-cd2d28f0-64c3-4714-b2ac-2ed156c9d813 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1576 microversion: 2.1 time: 0.158006 May 27 09:54:06.582204 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 574/1145] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:06 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:07.599332 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4987ad6e-57e9-4b0c-8f9e-0c96e4bfa2b1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:07.600019 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4987ad6e-57e9-4b0c-8f9e-0c96e4bfa2b1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:07.606035 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4987ad6e-57e9-4b0c-8f9e-0c96e4bfa2b1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:07.606478 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4987ad6e-57e9-4b0c-8f9e-0c96e4bfa2b1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:07.607226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4987ad6e-57e9-4b0c-8f9e-0c96e4bfa2b1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:07.607683 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4987ad6e-57e9-4b0c-8f9e-0c96e4bfa2b1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:07.790679 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4987ad6e-57e9-4b0c-8f9e-0c96e4bfa2b1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:07.798311 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4987ad6e-57e9-4b0c-8f9e-0c96e4bfa2b1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1576 microversion: 2.1 time: 0.203106 May 27 09:54:07.798873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 572/1146] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:07 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:08.638961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c8f0932f-a705-4815-a825-6c40c96a2ef7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f22892a4-db01-4021-90a8-5a44b711fb41"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:08.640218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c8f0932f-a705-4815-a825-6c40c96a2ef7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:08.647167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c8f0932f-a705-4815-a825-6c40c96a2ef7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:08.647747 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c8f0932f-a705-4815-a825-6c40c96a2ef7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:08.648575 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c8f0932f-a705-4815-a825-6c40c96a2ef7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:08.649073 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c8f0932f-a705-4815-a825-6c40c96a2ef7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:08.730620 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-c8f0932f-a705-4815-a825-6c40c96a2ef7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Invalid volume: volume f22892a4-db01-4021-90a8-5a44b711fb41 is already attached to instances: 670d7a28-aa3d-47d5-aa4e-d5701879d778 May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c8f0932f-a705-4815-a825-6c40c96a2ef7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: POST /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments HTTP/1.1 May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 74 May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:54:08.732395 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {"volumeAttachment": {"volumeId": "f22892a4-db01-4021-90a8-5a44b711fb41"}} May 27 09:54:08.734087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Invalid volume: volume f22892a4-db01-4021-90a8-5a44b711fb41 is already attached to instances: 670d7a28-aa3d-47d5-aa4e-d5701879d778 May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'server_id': '670d7a28-aa3d-47d5-aa4e-d5701879d778', 'body': {'volumeAttachment': {'volumeId': 'f22892a4-db01-4021-90a8-5a44b711fb41'}}} May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f22892a4-db01-4021-90a8-5a44b711fb41 is already attached to instances: 670d7a28-aa3d-47d5-aa4e-d5701879d778 May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:08.734919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f22892a4-db01-4021-90a8-5a44b711fb41 is already attached to instances: 670d7a28-aa3d-47d5-aa4e-d5701879d778 May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:08.736193 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:08.737447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:08.737447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:08.737447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:08.737447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f22892a4-db01-4021-90a8-5a44b711fb41 is already attached to instances: 670d7a28-aa3d-47d5-aa4e-d5701879d778 May 27 09:54:08.737447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:08.737447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c8f0932f-a705-4815-a825-6c40c96a2ef7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 400 to user: Invalid volume: volume f22892a4-db01-4021-90a8-5a44b711fb41 is already attached to instances: 670d7a28-aa3d-47d5-aa4e-d5701879d778 {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:08.737447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c8f0932f-a705-4815-a825-6c40c96a2ef7 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098887 May 27 09:54:08.737447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 575/1147] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:54:08 2022] POST /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 09:54:08.795269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-e8513331-9571-4748-8265-720d06d2405d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:08.795842 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-e8513331-9571-4748-8265-720d06d2405d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:08.803199 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e8513331-9571-4748-8265-720d06d2405d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:08.803406 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e8513331-9571-4748-8265-720d06d2405d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:08.804216 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e8513331-9571-4748-8265-720d06d2405d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:08.804716 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-e8513331-9571-4748-8265-720d06d2405d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:08.816601 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ba641c42-7ce6-4217-a444-2c97bed8abbe tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:08.817401 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ba641c42-7ce6-4217-a444-2c97bed8abbe tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:08.824328 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba641c42-7ce6-4217-a444-2c97bed8abbe tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:08.824902 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba641c42-7ce6-4217-a444-2c97bed8abbe tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:08.825776 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba641c42-7ce6-4217-a444-2c97bed8abbe tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:08.826352 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba641c42-7ce6-4217-a444-2c97bed8abbe tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:08.890301 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-e8513331-9571-4748-8265-720d06d2405d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lazy-loading 'services' on Instance uuid 670d7a28-aa3d-47d5-aa4e-d5701879d778 {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:54:08.963776 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-e8513331-9571-4748-8265-720d06d2405d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments/f22892a4-db01-4021-90a8-5a44b711fb41" status: 202 len: 0 microversion: 2.1 time: 0.172127 May 27 09:54:08.964807 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 573/1148] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:54:08 2022] DELETE /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments/f22892a4-db01-4021-90a8-5a44b711fb41 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:54:08.973329 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-712725cc-cdaf-483e-9806-96c82a0306db tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:08.974979 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-712725cc-cdaf-483e-9806-96c82a0306db tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:08.981344 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-712725cc-cdaf-483e-9806-96c82a0306db tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:08.981815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-712725cc-cdaf-483e-9806-96c82a0306db tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:08.982563 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-712725cc-cdaf-483e-9806-96c82a0306db tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:08.983174 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-712725cc-cdaf-483e-9806-96c82a0306db tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:09.014338 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-712725cc-cdaf-483e-9806-96c82a0306db tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045305 May 27 09:54:09.014969 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 574/1149] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:54:08 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:54:09.055610 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-ba641c42-7ce6-4217-a444-2c97bed8abbe tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:09.063944 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ba641c42-7ce6-4217-a444-2c97bed8abbe tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1576 microversion: 2.1 time: 0.251294 May 27 09:54:09.065134 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 576/1150] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:08 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1576 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:54:09.461654 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-099deded-9fa4-433c-a72c-5f4175b9bfff req-4c5c2ffb-2bab-439a-b08b-05f5a536b545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0e13117-8fb3-47ff-86e7-79d912a1482b", "name": "network-vif-deleted", "tag": "26f605f8-7eb5-4baa-801a-abfbce1e6b77"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:09.478915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-099deded-9fa4-433c-a72c-5f4175b9bfff req-4c5c2ffb-2bab-439a-b08b-05f5a536b545 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:09.479849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-099deded-9fa4-433c-a72c-5f4175b9bfff req-4c5c2ffb-2bab-439a-b08b-05f5a536b545 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:09.497386 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-099deded-9fa4-433c-a72c-5f4175b9bfff req-4c5c2ffb-2bab-439a-b08b-05f5a536b545 service nova] Creating event network-vif-deleted:26f605f8-7eb5-4baa-801a-abfbce1e6b77 for instance d0e13117-8fb3-47ff-86e7-79d912a1482b on hv-cinder-79760 May 27 09:54:09.508300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-099deded-9fa4-433c-a72c-5f4175b9bfff req-4c5c2ffb-2bab-439a-b08b-05f5a536b545 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053988 May 27 09:54:09.509104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 575/1151] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:10.026488 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5a885999-bd07-47c5-9f58-2f6c22b98b41 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:10.028096 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5a885999-bd07-47c5-9f58-2f6c22b98b41 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:10.039901 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5a885999-bd07-47c5-9f58-2f6c22b98b41 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:10.040359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5a885999-bd07-47c5-9f58-2f6c22b98b41 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:10.041148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5a885999-bd07-47c5-9f58-2f6c22b98b41 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:10.041596 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5a885999-bd07-47c5-9f58-2f6c22b98b41 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:10.081051 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5a885999-bd07-47c5-9f58-2f6c22b98b41 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058612 May 27 09:54:10.082657 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 577/1152] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:54:10 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:54:10.088171 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:10.088895 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:10.097847 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:10.098595 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:10.099461 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:10.099892 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:10.136732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:10.137551 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:10.138087 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lazy-loading 'fault' on Instance uuid d0e13117-8fb3-47ff-86e7-79d912a1482b {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:54:10.200206 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:10.207606 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-91354f49-4683-4d18-b59e-392f45dc8a8a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 200 len: 1230 microversion: 2.1 time: 0.129588 May 27 09:54:10.208179 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 576/1153] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:10 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 1230 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:11.094097 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-cf6ff448-d575-445e-9ff4-9d8fa863888f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:11.095014 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-cf6ff448-d575-445e-9ff4-9d8fa863888f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:11.101436 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cf6ff448-d575-445e-9ff4-9d8fa863888f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:11.101891 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cf6ff448-d575-445e-9ff4-9d8fa863888f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:11.102683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cf6ff448-d575-445e-9ff4-9d8fa863888f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:11.103118 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cf6ff448-d575-445e-9ff4-9d8fa863888f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:11.131625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-cf6ff448-d575-445e-9ff4-9d8fa863888f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040924 May 27 09:54:11.132175 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 578/1154] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:54:11 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:54:11.188839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-811f8b69-5dec-4e6a-8fe6-805f6b249963 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:11.189380 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-811f8b69-5dec-4e6a-8fe6-805f6b249963 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:11.196451 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-811f8b69-5dec-4e6a-8fe6-805f6b249963 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:11.196899 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-811f8b69-5dec-4e6a-8fe6-805f6b249963 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:11.197658 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-811f8b69-5dec-4e6a-8fe6-805f6b249963 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:11.198094 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-811f8b69-5dec-4e6a-8fe6-805f6b249963 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:11.224202 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-811f8b69-5dec-4e6a-8fe6-805f6b249963 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Going to try to terminate instance {{(pid=129291) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:54:11.224762 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e8250c1b-266d-4631-a978-20d17cd79419 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:11.225373 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e8250c1b-266d-4631-a978-20d17cd79419 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:11.231252 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e8250c1b-266d-4631-a978-20d17cd79419 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:11.231727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e8250c1b-266d-4631-a978-20d17cd79419 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:11.232486 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e8250c1b-266d-4631-a978-20d17cd79419 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:11.232923 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e8250c1b-266d-4631-a978-20d17cd79419 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:11.246722 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-e8250c1b-266d-4631-a978-20d17cd79419 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] HTTP exception thrown: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e8250c1b-266d-4631-a978-20d17cd79419 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Request method failure captured: May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b HTTP/1.1 May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ7zp-hV1znBYHXXcYN4xBIPDL0Hj-BZ4ZYsItQxyY_4ebbDF8y9_oItdL2GbEvG5SOshLmHcmP9aTfPkWRKTHUoRyOykU4fQmbe2IjFN2o_PMD0wRsyyM19EB_al3PEaGqYXy394jYKko6TRvzVlxyZwfL5FmsKXOun1CEfKwUfWjs May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 0fb2f335c9b540af8f7119c85656efad May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-TestVolumeBootPattern-712456051 May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:54:11.248284 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0fb2f335c9b540af8f7119c85656efad"}]}] May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-TestVolumeBootPattern-712456051 May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 0fb2f335c9b540af8f7119c85656efad May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-TestVolumeBootPattern-712456051 May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-TestVolumeBootPattern-712456051-project May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: f1fa5f1765ed4995b31a1600ce3edb07 May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-TestVolumeBootPattern-712456051-project May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:54:11.249874 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': 'd0e13117-8fb3-47ff-86e7-79d912a1482b'} May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:11.250803 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:54:11.252107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:11.253235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e8250c1b-266d-4631-a978-20d17cd79419 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Returning 404 to user: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:11.253235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e8250c1b-266d-4631-a978-20d17cd79419 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 404 len: 111 microversion: 2.1 time: 0.028913 May 27 09:54:11.253235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 579/1155] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:11 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 09:54:11.298737 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-811f8b69-5dec-4e6a-8fe6-805f6b249963 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 204 len: 0 microversion: 2.1 time: 0.113483 May 27 09:54:11.299611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 577/1156] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:54:11 2022] DELETE /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 09:54:11.311698 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-886f4529-d44f-4b64-85b9-c852703d6b9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:11.312320 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-886f4529-d44f-4b64-85b9-c852703d6b9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:11.319040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-886f4529-d44f-4b64-85b9-c852703d6b9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:11.319577 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-886f4529-d44f-4b64-85b9-c852703d6b9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:11.320232 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-886f4529-d44f-4b64-85b9-c852703d6b9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:11.320698 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-886f4529-d44f-4b64-85b9-c852703d6b9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:11.349173 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1790360321", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-830294606", "security_groups": [{"name": "tempest-secgroup-smoke-861602896"}], "block_device_mapping_v2": [{"uuid": "32843338-6137-49ff-bbd8-3340dd4e10d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f077ba7a-e018-4516-8e3d-23ac2b5e2506"}]}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:11.472258 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-886f4529-d44f-4b64-85b9-c852703d6b9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:11.480297 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-886f4529-d44f-4b64-85b9-c852703d6b9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1679 microversion: 2.1 time: 0.175847 May 27 09:54:11.481064 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 580/1157] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:11 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:11.487353 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.network.neutron [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] validate_networks() for [('f077ba7a-e018-4516-8e3d-23ac2b5e2506', None, None, None, None, None)] {{(pid=129291) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:54:11.847052 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Flavor limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:54:11.847458 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Image limits 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:54:11.847930 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Flavor pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:54:11.848356 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Image pref 0:0:0 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:54:11.848764 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.virt.hardware [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:54:11.858246 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:11.858692 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:11.859537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:11.859972 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:11.876104 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Getting quotas for project 0fb2f335c9b540af8f7119c85656efad. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:54:11.879992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Getting quotas for user f1fa5f1765ed4995b31a1600ce3edb07 and project 0fb2f335c9b540af8f7119c85656efad. Resources: {'instances', 'ram', 'cores'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:54:11.936353 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Going to run 1 instances... {{(pid=129291) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:54:11.938506 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32843338-6137-49ff-bbd8-3340dd4e10d9',volume_size=None,volume_type=None)] {{(pid=129291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:54:12.062660 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-15c97732-9e6d-406d-8a08-ef913ef44fa7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.717487 May 27 09:54:12.067716 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 578/1158] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:54:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 09:54:12.073416 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d9a2acff-6552-4182-9416-bc7ec6e14af2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:12.074133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d9a2acff-6552-4182-9416-bc7ec6e14af2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:12.130955 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d9a2acff-6552-4182-9416-bc7ec6e14af2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:12.137678 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d9a2acff-6552-4182-9416-bc7ec6e14af2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1094 microversion: 2.1 time: 0.068070 May 27 09:54:12.138246 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 581/1159] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:12 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:12.497973 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a011fd7b-90a5-47d5-a928-6f8caedacac4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:12.498585 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a011fd7b-90a5-47d5-a928-6f8caedacac4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:12.505359 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a011fd7b-90a5-47d5-a928-6f8caedacac4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:12.505805 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a011fd7b-90a5-47d5-a928-6f8caedacac4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:12.506569 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a011fd7b-90a5-47d5-a928-6f8caedacac4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:12.507006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a011fd7b-90a5-47d5-a928-6f8caedacac4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:12.651997 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a011fd7b-90a5-47d5-a928-6f8caedacac4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:12.659377 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a011fd7b-90a5-47d5-a928-6f8caedacac4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1679 microversion: 2.1 time: 0.165763 May 27 09:54:12.659950 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 579/1160] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:12 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:13.155083 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c40b06d5-b227-4e14-b8f8-7107c5906071 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:13.155722 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c40b06d5-b227-4e14-b8f8-7107c5906071 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:13.165442 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c40b06d5-b227-4e14-b8f8-7107c5906071 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:13.165886 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c40b06d5-b227-4e14-b8f8-7107c5906071 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:13.166664 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c40b06d5-b227-4e14-b8f8-7107c5906071 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:13.167094 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c40b06d5-b227-4e14-b8f8-7107c5906071 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:13.228044 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c40b06d5-b227-4e14-b8f8-7107c5906071 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:13.235557 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c40b06d5-b227-4e14-b8f8-7107c5906071 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1192 microversion: 2.1 time: 0.084284 May 27 09:54:13.236125 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 582/1161] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:13 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:13.677136 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5544e28d-90cb-44ab-a6d8-1b17fdc22f93 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:13.678267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5544e28d-90cb-44ab-a6d8-1b17fdc22f93 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:13.687297 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5544e28d-90cb-44ab-a6d8-1b17fdc22f93 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:13.688021 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5544e28d-90cb-44ab-a6d8-1b17fdc22f93 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:13.688978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5544e28d-90cb-44ab-a6d8-1b17fdc22f93 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:13.689588 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5544e28d-90cb-44ab-a6d8-1b17fdc22f93 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:13.996413 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5544e28d-90cb-44ab-a6d8-1b17fdc22f93 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:14.004199 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5544e28d-90cb-44ab-a6d8-1b17fdc22f93 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1679 microversion: 2.1 time: 0.330953 May 27 09:54:14.004787 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 580/1162] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:13 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:14.254065 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-718bdb1b-5b94-4bd0-8095-6be7b52acd83 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:14.254608 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-718bdb1b-5b94-4bd0-8095-6be7b52acd83 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:14.261753 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-718bdb1b-5b94-4bd0-8095-6be7b52acd83 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:14.262195 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-718bdb1b-5b94-4bd0-8095-6be7b52acd83 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:14.262954 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-718bdb1b-5b94-4bd0-8095-6be7b52acd83 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:14.263438 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-718bdb1b-5b94-4bd0-8095-6be7b52acd83 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:14.342851 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-718bdb1b-5b94-4bd0-8095-6be7b52acd83 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:14.350382 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-718bdb1b-5b94-4bd0-8095-6be7b52acd83 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1198 microversion: 2.1 time: 0.101040 May 27 09:54:14.351142 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 583/1163] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:14 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1198 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:15.024383 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a70f65be-0312-4113-94bf-f575ea8b196f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:15.025570 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a70f65be-0312-4113-94bf-f575ea8b196f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:15.047396 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a70f65be-0312-4113-94bf-f575ea8b196f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:15.053225 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a70f65be-0312-4113-94bf-f575ea8b196f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:15.054088 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a70f65be-0312-4113-94bf-f575ea8b196f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:15.054537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a70f65be-0312-4113-94bf-f575ea8b196f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:15.210323 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a70f65be-0312-4113-94bf-f575ea8b196f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:15.218381 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a70f65be-0312-4113-94bf-f575ea8b196f tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 200 len: 1611 microversion: 2.1 time: 0.199032 May 27 09:54:15.219143 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 581/1164] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:15 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 1611 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:15.259189 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-12d835e3-1c6e-4190-805a-ab8f64cebaec req-4930180b-9c71-4b1e-9d01-1f79cd612cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "670d7a28-aa3d-47d5-aa4e-d5701879d778", "name": "network-vif-deleted", "tag": "5f226c35-6541-4cc7-bf91-5784ae9faaa4"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:15.270237 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-12d835e3-1c6e-4190-805a-ab8f64cebaec req-4930180b-9c71-4b1e-9d01-1f79cd612cf9 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:15.270843 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-12d835e3-1c6e-4190-805a-ab8f64cebaec req-4930180b-9c71-4b1e-9d01-1f79cd612cf9 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:15.286658 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-12d835e3-1c6e-4190-805a-ab8f64cebaec req-4930180b-9c71-4b1e-9d01-1f79cd612cf9 service nova] Creating event network-vif-deleted:5f226c35-6541-4cc7-bf91-5784ae9faaa4 for instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 on hv-cinder-79760 May 27 09:54:15.293769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-12d835e3-1c6e-4190-805a-ab8f64cebaec req-4930180b-9c71-4b1e-9d01-1f79cd612cf9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039672 May 27 09:54:15.295266 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 584/1165] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:15.369762 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-384cda48-d059-41dc-939f-33c01d229c27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:15.371010 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-384cda48-d059-41dc-939f-33c01d229c27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:15.376955 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-384cda48-d059-41dc-939f-33c01d229c27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:15.377662 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-384cda48-d059-41dc-939f-33c01d229c27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:15.378635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-384cda48-d059-41dc-939f-33c01d229c27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:15.379074 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-384cda48-d059-41dc-939f-33c01d229c27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:15.608348 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-384cda48-d059-41dc-939f-33c01d229c27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:15.616426 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-384cda48-d059-41dc-939f-33c01d229c27 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.251301 May 27 09:54:15.617138 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 582/1166] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:15 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:16.237119 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5af22995-bd02-45ce-991a-f6ead41e778a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:16.237835 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5af22995-bd02-45ce-991a-f6ead41e778a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:16.251433 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5af22995-bd02-45ce-991a-f6ead41e778a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:16.251888 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5af22995-bd02-45ce-991a-f6ead41e778a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:16.252667 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5af22995-bd02-45ce-991a-f6ead41e778a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:16.253104 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5af22995-bd02-45ce-991a-f6ead41e778a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:16.267394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-5af22995-bd02-45ce-991a-f6ead41e778a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5af22995-bd02-45ce-991a-f6ead41e778a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 HTTP/1.1 May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:54:16.269040 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:54:16.270446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '670d7a28-aa3d-47d5-aa4e-d5701879d778'} May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:16.271798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:54:16.273053 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:54:16.275796 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5af22995-bd02-45ce-991a-f6ead41e778a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:16.276922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5af22995-bd02-45ce-991a-f6ead41e778a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 404 len: 111 microversion: 2.1 time: 0.044038 May 27 09:54:16.277279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 585/1167] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:16 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:54:16.285576 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fe581fa9-cccf-4f97-9336-03e41fc40e01 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '.version_select at 0x7f188c271430>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:16.304989 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fe581fa9-cccf-4f97-9336-03e41fc40e01 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588651095" status: 202 len: 0 microversion: 2.1 time: 0.023137 May 27 09:54:16.305576 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 583/1168] 10.222.0.41 () {58 vars in 1217 bytes} [Fri May 27 09:54:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588651095 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:54:16.633639 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fd00eed2-d4f0-426c-b020-d8c070d19260 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:16.634263 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fd00eed2-d4f0-426c-b020-d8c070d19260 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:16.640279 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fd00eed2-d4f0-426c-b020-d8c070d19260 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:16.640724 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fd00eed2-d4f0-426c-b020-d8c070d19260 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:16.641482 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fd00eed2-d4f0-426c-b020-d8c070d19260 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:16.641909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fd00eed2-d4f0-426c-b020-d8c070d19260 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:16.856202 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fd00eed2-d4f0-426c-b020-d8c070d19260 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:16.863961 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fd00eed2-d4f0-426c-b020-d8c070d19260 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.234313 May 27 09:54:16.864867 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 586/1169] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:16 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:17.017357 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-426f1b8c-9c53-40eb-90d0-b38aff0dc263 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: .version_select at 0x7f1890b37ee0>, body: {"keypair": {"name": "tempest-keypair-1227222033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiltb7zPePkPzdnU5XGKHMAqkBD9fjdoJv94mNwAv419SRjrn5USgniHM8I849C2KukexNmAuElsh+5ec3/UZZz4Vdfv709+rb6xlsM8P8o4Ed5CQD8DNo7a21NEO6exQ=="}} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:17.031512 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-426f1b8c-9c53-40eb-90d0-b38aff0dc263 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for project 43091208be574e6e8cc348667792f751. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:54:17.035391 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.quota [None req-426f1b8c-9c53-40eb-90d0-b38aff0dc263 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for user 8d96e9d955934f0e883df57a3bcf934d and project 43091208be574e6e8cc348667792f751. Resources: {'key_pairs'} {{(pid=129291) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:54:17.058278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-426f1b8c-9c53-40eb-90d0-b38aff0dc263 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044934 May 27 09:54:17.058874 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 584/1170] 10.222.0.41 () {60 vars in 1158 bytes} [Fri May 27 09:54:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:17.311004 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-9511e803-8e8b-4806-a34e-c29cca27f52e req-69d161b6-849f-40c8-8276-68b2796f2dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe94756-b459-402b-ae34-6c33212dbfeb", "tag": "a5872eee-9e8c-4b27-9455-b29cc8304599"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:17.320128 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-9511e803-8e8b-4806-a34e-c29cca27f52e req-69d161b6-849f-40c8-8276-68b2796f2dcd service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:17.320551 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-9511e803-8e8b-4806-a34e-c29cca27f52e req-69d161b6-849f-40c8-8276-68b2796f2dcd service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:17.331385 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-9511e803-8e8b-4806-a34e-c29cca27f52e req-69d161b6-849f-40c8-8276-68b2796f2dcd service nova] Creating event network-changed:a5872eee-9e8c-4b27-9455-b29cc8304599 for instance 7fe94756-b459-402b-ae34-6c33212dbfeb on hv-cinder-79760 May 27 09:54:17.336887 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-9511e803-8e8b-4806-a34e-c29cca27f52e req-69d161b6-849f-40c8-8276-68b2796f2dcd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030070 May 27 09:54:17.337946 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 587/1171] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:17.881484 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1b505ca3-7e73-479d-a437-9a9f8434deeb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:17.882262 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1b505ca3-7e73-479d-a437-9a9f8434deeb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:17.888922 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1b505ca3-7e73-479d-a437-9a9f8434deeb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:17.889521 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1b505ca3-7e73-479d-a437-9a9f8434deeb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:17.890619 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1b505ca3-7e73-479d-a437-9a9f8434deeb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:17.891162 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1b505ca3-7e73-479d-a437-9a9f8434deeb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:18.029126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1b505ca3-7e73-479d-a437-9a9f8434deeb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:18.032803 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:18.038235 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1b505ca3-7e73-479d-a437-9a9f8434deeb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.161093 May 27 09:54:18.038916 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 585/1172] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:17 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:18.577982 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1689097045", "imageRef": "e3ec2a4a-f474-400a-9711-45dc0cae81d5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f851c882-debd-4ebe-9da5-a1c317e6e8ac"}], "security_groups": [{"name": "tempest-securitygroup--1939709688"}], "key_name": "tempest-keypair-1227222033", "user_data": "}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:18.682235 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] validate_networks() for [('f851c882-debd-4ebe-9da5-a1c317e6e8ac', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:54:19.055265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-090f699f-5c3e-4f7d-8940-d0cb0a44495c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:19.055829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-090f699f-5c3e-4f7d-8940-d0cb0a44495c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:19.065662 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-090f699f-5c3e-4f7d-8940-d0cb0a44495c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:19.066522 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-090f699f-5c3e-4f7d-8940-d0cb0a44495c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:19.067000 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-090f699f-5c3e-4f7d-8940-d0cb0a44495c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:19.067476 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-090f699f-5c3e-4f7d-8940-d0cb0a44495c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:19.094302 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:54:19.094723 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:54:19.095189 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:54:19.095645 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:54:19.096055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:54:19.104893 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:19.105334 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:19.106122 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:19.106581 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:19.123539 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for project 43091208be574e6e8cc348667792f751. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:54:19.127437 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Getting quotas for user 8d96e9d955934f0e883df57a3bcf934d and project 43091208be574e6e8cc348667792f751. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:54:19.138993 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:54:19.141406 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e3ec2a4a-f474-400a-9711-45dc0cae81d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:54:19.186830 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-4e65c560-dc67-449b-a360-569f8c342dd0 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613500 May 27 09:54:19.192503 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 588/1173] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:54:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:54:19.198334 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1d2872bc-f7e9-4956-8a5c-b1ac93fb3ef4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:19.198784 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-090f699f-5c3e-4f7d-8940-d0cb0a44495c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:19.198932 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1d2872bc-f7e9-4956-8a5c-b1ac93fb3ef4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:19.219991 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-090f699f-5c3e-4f7d-8940-d0cb0a44495c tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.168609 May 27 09:54:19.220763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 586/1174] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:19 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:54:19.252683 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1d2872bc-f7e9-4956-8a5c-b1ac93fb3ef4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:19.260529 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1d2872bc-f7e9-4956-8a5c-b1ac93fb3ef4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1242 microversion: 2.1 time: 0.066148 May 27 09:54:19.261144 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 589/1175] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:19 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:54:20.236660 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-039b6938-c0f9-41eb-b1d7-563102549f31 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:20.237279 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-039b6938-c0f9-41eb-b1d7-563102549f31 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:20.243848 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-039b6938-c0f9-41eb-b1d7-563102549f31 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:20.244293 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-039b6938-c0f9-41eb-b1d7-563102549f31 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:20.245068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-039b6938-c0f9-41eb-b1d7-563102549f31 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:20.245480 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-039b6938-c0f9-41eb-b1d7-563102549f31 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:20.284127 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2c5cd44f-93c5-4bcf-945a-2f4408a01e25 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:20.285125 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2c5cd44f-93c5-4bcf-945a-2f4408a01e25 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:20.293359 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2c5cd44f-93c5-4bcf-945a-2f4408a01e25 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:20.293919 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2c5cd44f-93c5-4bcf-945a-2f4408a01e25 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:20.294798 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2c5cd44f-93c5-4bcf-945a-2f4408a01e25 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:20.295381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2c5cd44f-93c5-4bcf-945a-2f4408a01e25 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:20.382304 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2c5cd44f-93c5-4bcf-945a-2f4408a01e25 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:20.389685 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2c5cd44f-93c5-4bcf-945a-2f4408a01e25 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1300 microversion: 2.1 time: 0.110235 May 27 09:54:20.390255 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 590/1176] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:20 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:20.482211 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-039b6938-c0f9-41eb-b1d7-563102549f31 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:20.489687 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-039b6938-c0f9-41eb-b1d7-563102549f31 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.256888 May 27 09:54:20.490366 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 587/1177] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:20 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:21.406466 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7ef5835f-5bd1-4671-aa21-cc78d6cbd355 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:21.407331 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-7ef5835f-5bd1-4671-aa21-cc78d6cbd355 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:21.413764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7ef5835f-5bd1-4671-aa21-cc78d6cbd355 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:21.414212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7ef5835f-5bd1-4671-aa21-cc78d6cbd355 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:21.415006 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7ef5835f-5bd1-4671-aa21-cc78d6cbd355 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:21.416086 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-7ef5835f-5bd1-4671-aa21-cc78d6cbd355 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:21.506395 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-16c9be6f-1dec-48ae-adb3-d72fac1367f3 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:21.507015 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-16c9be6f-1dec-48ae-adb3-d72fac1367f3 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:21.514747 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-16c9be6f-1dec-48ae-adb3-d72fac1367f3 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:21.515991 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-16c9be6f-1dec-48ae-adb3-d72fac1367f3 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:21.516807 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-16c9be6f-1dec-48ae-adb3-d72fac1367f3 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:21.517252 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-16c9be6f-1dec-48ae-adb3-d72fac1367f3 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:21.687148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-7ef5835f-5bd1-4671-aa21-cc78d6cbd355 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:21.694997 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7ef5835f-5bd1-4671-aa21-cc78d6cbd355 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1368 microversion: 2.1 time: 0.292378 May 27 09:54:21.695793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 591/1178] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:21 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1368 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:21.765300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-16c9be6f-1dec-48ae-adb3-d72fac1367f3 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:21.773414 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-16c9be6f-1dec-48ae-adb3-d72fac1367f3 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.271275 May 27 09:54:21.773996 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 588/1179] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:21 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:21.824410 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-9c562fb3-b8dd-428b-b3d1-72ec46eae9ee req-b3d03c4e-a72b-48b3-a5df-8ad47a8dce84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a782e9-c458-440c-8c00-3ad1eb73ffdb", "tag": "3c0d0516-0cd6-4400-aa39-bbacf571ace1"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:21.832930 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-9c562fb3-b8dd-428b-b3d1-72ec46eae9ee req-b3d03c4e-a72b-48b3-a5df-8ad47a8dce84 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:21.834377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-9c562fb3-b8dd-428b-b3d1-72ec46eae9ee req-b3d03c4e-a72b-48b3-a5df-8ad47a8dce84 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:21.846799 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-9c562fb3-b8dd-428b-b3d1-72ec46eae9ee req-b3d03c4e-a72b-48b3-a5df-8ad47a8dce84 service nova] Creating event network-changed:3c0d0516-0cd6-4400-aa39-bbacf571ace1 for instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb on hv-cinder-79760 May 27 09:54:21.852334 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-9c562fb3-b8dd-428b-b3d1-72ec46eae9ee req-b3d03c4e-a72b-48b3-a5df-8ad47a8dce84 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036830 May 27 09:54:21.853152 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 592/1180] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:22.712485 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4ee83db8-ff21-4cde-9a26-b3a6c803b1b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:22.713102 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4ee83db8-ff21-4cde-9a26-b3a6c803b1b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:22.714948 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:22.721093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4ee83db8-ff21-4cde-9a26-b3a6c803b1b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:22.721535 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4ee83db8-ff21-4cde-9a26-b3a6c803b1b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:22.722325 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4ee83db8-ff21-4cde-9a26-b3a6c803b1b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:22.722758 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4ee83db8-ff21-4cde-9a26-b3a6c803b1b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:22.790902 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5e98cad9-eef3-48bc-8e87-52f721858d85 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:22.791634 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5e98cad9-eef3-48bc-8e87-52f721858d85 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:22.798272 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e98cad9-eef3-48bc-8e87-52f721858d85 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:22.798720 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e98cad9-eef3-48bc-8e87-52f721858d85 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:22.799512 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e98cad9-eef3-48bc-8e87-52f721858d85 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:22.799943 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5e98cad9-eef3-48bc-8e87-52f721858d85 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:22.886127 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4ee83db8-ff21-4cde-9a26-b3a6c803b1b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:22.893468 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4ee83db8-ff21-4cde-9a26-b3a6c803b1b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1368 microversion: 2.1 time: 0.185757 May 27 09:54:22.894045 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 589/1181] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:22 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:22.952377 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5e98cad9-eef3-48bc-8e87-52f721858d85 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:22.959820 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5e98cad9-eef3-48bc-8e87-52f721858d85 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.173638 May 27 09:54:22.960381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 593/1182] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:22 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:54:23.912418 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d3828bf8-7ea3-4b42-b1c6-a04300627e5c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:23.913035 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d3828bf8-7ea3-4b42-b1c6-a04300627e5c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:23.919621 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d3828bf8-7ea3-4b42-b1c6-a04300627e5c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:23.920075 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d3828bf8-7ea3-4b42-b1c6-a04300627e5c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:23.920844 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d3828bf8-7ea3-4b42-b1c6-a04300627e5c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:23.921283 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d3828bf8-7ea3-4b42-b1c6-a04300627e5c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:23.976454 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-68146051-eac0-401c-99f5-02ebe7128403 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:23.977047 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-68146051-eac0-401c-99f5-02ebe7128403 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:23.983493 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68146051-eac0-401c-99f5-02ebe7128403 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:23.984007 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68146051-eac0-401c-99f5-02ebe7128403 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:23.984785 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68146051-eac0-401c-99f5-02ebe7128403 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:23.985226 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-68146051-eac0-401c-99f5-02ebe7128403 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:23.989344 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:24.093471 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d3828bf8-7ea3-4b42-b1c6-a04300627e5c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:24.101009 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d3828bf8-7ea3-4b42-b1c6-a04300627e5c tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1368 microversion: 2.1 time: 0.192448 May 27 09:54:24.101593 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 590/1183] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:23 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:24.138922 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-68146051-eac0-401c-99f5-02ebe7128403 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:24.146589 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-68146051-eac0-401c-99f5-02ebe7128403 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.173940 May 27 09:54:24.147167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 594/1184] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:23 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:54:25.117733 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-da043dfb-9ab1-4cef-8f77-f0f5a2537050 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:25.118350 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-da043dfb-9ab1-4cef-8f77-f0f5a2537050 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:25.124849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-da043dfb-9ab1-4cef-8f77-f0f5a2537050 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:25.125307 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-da043dfb-9ab1-4cef-8f77-f0f5a2537050 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:25.126072 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-da043dfb-9ab1-4cef-8f77-f0f5a2537050 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:25.126512 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-da043dfb-9ab1-4cef-8f77-f0f5a2537050 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:25.162243 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-35cd6dea-c5a6-436e-b50b-3f041d8b9925 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:25.162855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-35cd6dea-c5a6-436e-b50b-3f041d8b9925 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:25.169420 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35cd6dea-c5a6-436e-b50b-3f041d8b9925 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:25.169872 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35cd6dea-c5a6-436e-b50b-3f041d8b9925 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:25.170648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35cd6dea-c5a6-436e-b50b-3f041d8b9925 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:25.171087 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-35cd6dea-c5a6-436e-b50b-3f041d8b9925 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:25.310267 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-da043dfb-9ab1-4cef-8f77-f0f5a2537050 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:25.318314 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-da043dfb-9ab1-4cef-8f77-f0f5a2537050 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1368 microversion: 2.1 time: 0.203899 May 27 09:54:25.318792 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 591/1185] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:25 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:25.339158 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-35cd6dea-c5a6-436e-b50b-3f041d8b9925 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:25.346694 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-35cd6dea-c5a6-436e-b50b-3f041d8b9925 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.188184 May 27 09:54:25.347259 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 595/1186] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:25 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:54:26.335544 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5aaa5741-5e6a-422a-a5cd-91c8459f5960 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:26.336196 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5aaa5741-5e6a-422a-a5cd-91c8459f5960 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:26.342977 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5aaa5741-5e6a-422a-a5cd-91c8459f5960 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:26.343467 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5aaa5741-5e6a-422a-a5cd-91c8459f5960 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:26.344230 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5aaa5741-5e6a-422a-a5cd-91c8459f5960 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:26.344669 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5aaa5741-5e6a-422a-a5cd-91c8459f5960 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:26.362788 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-d078fc3f-61bb-472f-b9b5-3feb464f1ea1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:26.363423 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-d078fc3f-61bb-472f-b9b5-3feb464f1ea1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:26.369804 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d078fc3f-61bb-472f-b9b5-3feb464f1ea1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:26.370248 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d078fc3f-61bb-472f-b9b5-3feb464f1ea1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:26.371011 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d078fc3f-61bb-472f-b9b5-3feb464f1ea1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:26.371490 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-d078fc3f-61bb-472f-b9b5-3feb464f1ea1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:26.542815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5aaa5741-5e6a-422a-a5cd-91c8459f5960 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:26.546161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-d078fc3f-61bb-472f-b9b5-3feb464f1ea1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:26.550318 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5aaa5741-5e6a-422a-a5cd-91c8459f5960 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1368 microversion: 2.1 time: 0.219213 May 27 09:54:26.550978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 592/1187] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:26 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:26.553531 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-d078fc3f-61bb-472f-b9b5-3feb464f1ea1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.194568 May 27 09:54:26.554092 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 596/1188] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:26 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:54:27.567324 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-53800729-d143-4203-b6d9-1bd9f253439a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:27.567972 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-53800729-d143-4203-b6d9-1bd9f253439a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:27.569572 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-81746419-64bc-463f-97f9-3e472858f2b0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:27.570045 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=10 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:27.570167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-81746419-64bc-463f-97f9-3e472858f2b0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:27.575799 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-53800729-d143-4203-b6d9-1bd9f253439a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:27.576250 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-53800729-d143-4203-b6d9-1bd9f253439a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:27.576827 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81746419-64bc-463f-97f9-3e472858f2b0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:27.577021 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-53800729-d143-4203-b6d9-1bd9f253439a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:27.577276 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81746419-64bc-463f-97f9-3e472858f2b0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:27.577458 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-53800729-d143-4203-b6d9-1bd9f253439a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:27.578041 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81746419-64bc-463f-97f9-3e472858f2b0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:27.578480 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-81746419-64bc-463f-97f9-3e472858f2b0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:28.037292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-53800729-d143-4203-b6d9-1bd9f253439a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:28.041131 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-81746419-64bc-463f-97f9-3e472858f2b0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:28.044832 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-53800729-d143-4203-b6d9-1bd9f253439a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1368 microversion: 2.1 time: 0.481397 May 27 09:54:28.045412 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 593/1189] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:27 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1368 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:28.048532 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-81746419-64bc-463f-97f9-3e472858f2b0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.482714 May 27 09:54:28.049093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 597/1190] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:27 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:54:28.944151 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-be0fa2e8-16f2-4329-acc3-b6debd8f4222 req-a19f0407-ba93-4a46-a107-69b74255783c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a782e9-c458-440c-8c00-3ad1eb73ffdb", "name": "network-vif-plugged", "status": "completed", "tag": "3c0d0516-0cd6-4400-aa39-bbacf571ace1"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:28.949873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:28.956980 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-be0fa2e8-16f2-4329-acc3-b6debd8f4222 req-a19f0407-ba93-4a46-a107-69b74255783c service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:28.957426 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-be0fa2e8-16f2-4329-acc3-b6debd8f4222 req-a19f0407-ba93-4a46-a107-69b74255783c service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:28.971323 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-be0fa2e8-16f2-4329-acc3-b6debd8f4222 req-a19f0407-ba93-4a46-a107-69b74255783c service nova] Creating event network-vif-plugged:3c0d0516-0cd6-4400-aa39-bbacf571ace1 for instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb on hv-cinder-79760 May 27 09:54:28.976335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-be0fa2e8-16f2-4329-acc3-b6debd8f4222 req-a19f0407-ba93-4a46-a107-69b74255783c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036545 May 27 09:54:28.976940 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 594/1191] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:29.062999 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-fc9b4f8e-b77d-4e47-b991-8e6d052a0809 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:29.065347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-fc9b4f8e-b77d-4e47-b991-8e6d052a0809 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:29.067770 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9747a86d-b849-46af-8cac-f3e9bb1d2473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:29.070149 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-9747a86d-b849-46af-8cac-f3e9bb1d2473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:29.077458 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc9b4f8e-b77d-4e47-b991-8e6d052a0809 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:29.077897 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9747a86d-b849-46af-8cac-f3e9bb1d2473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:29.078367 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc9b4f8e-b77d-4e47-b991-8e6d052a0809 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:29.079291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9747a86d-b849-46af-8cac-f3e9bb1d2473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:29.079434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc9b4f8e-b77d-4e47-b991-8e6d052a0809 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:29.079838 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-fc9b4f8e-b77d-4e47-b991-8e6d052a0809 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:29.080736 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9747a86d-b849-46af-8cac-f3e9bb1d2473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:29.081179 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-9747a86d-b849-46af-8cac-f3e9bb1d2473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:29.114517 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:29.257909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=10 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:29.342359 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-9747a86d-b849-46af-8cac-f3e9bb1d2473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:29.349806 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9747a86d-b849-46af-8cac-f3e9bb1d2473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.288015 May 27 09:54:29.350393 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 595/1192] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:29 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:29.354246 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-fc9b4f8e-b77d-4e47-b991-8e6d052a0809 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:29.361498 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-fc9b4f8e-b77d-4e47-b991-8e6d052a0809 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1368 microversion: 2.1 time: 0.303881 May 27 09:54:29.362049 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 598/1193] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:29 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:30.367875 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-95b7b735-0283-49fe-94a8-196c1ee8cee8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:30.368415 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-95b7b735-0283-49fe-94a8-196c1ee8cee8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:30.374796 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-95b7b735-0283-49fe-94a8-196c1ee8cee8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:30.375237 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-95b7b735-0283-49fe-94a8-196c1ee8cee8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:30.376024 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-95b7b735-0283-49fe-94a8-196c1ee8cee8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:30.376458 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-95b7b735-0283-49fe-94a8-196c1ee8cee8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:30.377853 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-12fc7865-1287-4a93-aaa1-475319475398 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:30.378468 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-12fc7865-1287-4a93-aaa1-475319475398 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:30.380787 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:30.386524 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-12fc7865-1287-4a93-aaa1-475319475398 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:30.386975 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-12fc7865-1287-4a93-aaa1-475319475398 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:30.387773 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-12fc7865-1287-4a93-aaa1-475319475398 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:30.388211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-12fc7865-1287-4a93-aaa1-475319475398 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:30.572897 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-95b7b735-0283-49fe-94a8-196c1ee8cee8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:30.576560 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-12fc7865-1287-4a93-aaa1-475319475398 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:30.580501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-95b7b735-0283-49fe-94a8-196c1ee8cee8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.217002 May 27 09:54:30.581098 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 596/1194] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:30 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:30.583978 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-12fc7865-1287-4a93-aaa1-475319475398 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1368 microversion: 2.1 time: 0.210025 May 27 09:54:30.584540 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 599/1195] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:30 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:30.999932 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-22c7b920-a2e2-4f2c-ab6f-4a2f80165169 req-af013c82-eafe-4be7-8a19-1054d0cbff56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe94756-b459-402b-ae34-6c33212dbfeb", "name": "network-vif-plugged", "status": "completed", "tag": "a5872eee-9e8c-4b27-9455-b29cc8304599"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:31.008478 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-22c7b920-a2e2-4f2c-ab6f-4a2f80165169 req-af013c82-eafe-4be7-8a19-1054d0cbff56 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:31.008946 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-22c7b920-a2e2-4f2c-ab6f-4a2f80165169 req-af013c82-eafe-4be7-8a19-1054d0cbff56 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:31.019335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-22c7b920-a2e2-4f2c-ab6f-4a2f80165169 req-af013c82-eafe-4be7-8a19-1054d0cbff56 service nova] Creating event network-vif-plugged:a5872eee-9e8c-4b27-9455-b29cc8304599 for instance 7fe94756-b459-402b-ae34-6c33212dbfeb on hv-cinder-79760 May 27 09:54:31.024816 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-22c7b920-a2e2-4f2c-ab6f-4a2f80165169 req-af013c82-eafe-4be7-8a19-1054d0cbff56 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028552 May 27 09:54:31.025368 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 597/1196] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:31.597242 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-c1259640-afd9-41cd-b31b-90e141aef455 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:31.597852 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-c1259640-afd9-41cd-b31b-90e141aef455 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:31.601432 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-39e50975-e87d-43c3-83f4-b7179a979636 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:31.602126 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-39e50975-e87d-43c3-83f4-b7179a979636 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:31.604361 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c1259640-afd9-41cd-b31b-90e141aef455 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:31.604809 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c1259640-afd9-41cd-b31b-90e141aef455 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:31.605574 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c1259640-afd9-41cd-b31b-90e141aef455 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:31.606043 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-c1259640-afd9-41cd-b31b-90e141aef455 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:31.608260 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39e50975-e87d-43c3-83f4-b7179a979636 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:31.608719 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39e50975-e87d-43c3-83f4-b7179a979636 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:31.609466 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39e50975-e87d-43c3-83f4-b7179a979636 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:31.609901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-39e50975-e87d-43c3-83f4-b7179a979636 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:31.810979 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-c1259640-afd9-41cd-b31b-90e141aef455 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:31.814206 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-39e50975-e87d-43c3-83f4-b7179a979636 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:31.818529 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-c1259640-afd9-41cd-b31b-90e141aef455 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1265 microversion: 2.1 time: 0.225075 May 27 09:54:31.819098 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 600/1197] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:31 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:31.821632 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-39e50975-e87d-43c3-83f4-b7179a979636 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1557 microversion: 2.1 time: 0.224803 May 27 09:54:31.822184 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 598/1198] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:31 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1557 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:54:31.837564 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-108d7722-98c7-4d3c-bd41-8b52a482c763 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:31.838056 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-108d7722-98c7-4d3c-bd41-8b52a482c763 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:31.844011 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-108d7722-98c7-4d3c-bd41-8b52a482c763 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:31.844457 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-108d7722-98c7-4d3c-bd41-8b52a482c763 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:31.845216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-108d7722-98c7-4d3c-bd41-8b52a482c763 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:31.845650 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-108d7722-98c7-4d3c-bd41-8b52a482c763 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:31.925954 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-108d7722-98c7-4d3c-bd41-8b52a482c763 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092339 May 27 09:54:31.926550 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 601/1199] 10.222.0.41 () {58 vars in 1274 bytes} [Fri May 27 09:54:31 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:54:32.838007 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-31871c9b-36f7-4804-a890-297ab3a2fcc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:32.840828 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-673266a7-04a9-4c92-91a9-a23fb2d80c56 req-0c270ff3-785c-4b04-b934-1a9150513653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a782e9-c458-440c-8c00-3ad1eb73ffdb", "tag": "3c0d0516-0cd6-4400-aa39-bbacf571ace1"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:32.842036 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-31871c9b-36f7-4804-a890-297ab3a2fcc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:32.853471 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-31871c9b-36f7-4804-a890-297ab3a2fcc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:32.854022 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-31871c9b-36f7-4804-a890-297ab3a2fcc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:32.854526 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-673266a7-04a9-4c92-91a9-a23fb2d80c56 req-0c270ff3-785c-4b04-b934-1a9150513653 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:32.854979 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-673266a7-04a9-4c92-91a9-a23fb2d80c56 req-0c270ff3-785c-4b04-b934-1a9150513653 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:32.855114 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-31871c9b-36f7-4804-a890-297ab3a2fcc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:32.855559 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-31871c9b-36f7-4804-a890-297ab3a2fcc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:32.866140 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-673266a7-04a9-4c92-91a9-a23fb2d80c56 req-0c270ff3-785c-4b04-b934-1a9150513653 service nova] Creating event network-changed:3c0d0516-0cd6-4400-aa39-bbacf571ace1 for instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb on hv-cinder-79760 May 27 09:54:32.870941 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-673266a7-04a9-4c92-91a9-a23fb2d80c56 req-0c270ff3-785c-4b04-b934-1a9150513653 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042987 May 27 09:54:32.871746 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 599/1200] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:32.995704 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-31871c9b-36f7-4804-a890-297ab3a2fcc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:33.003474 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-31871c9b-36f7-4804-a890-297ab3a2fcc9 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1451 microversion: 2.1 time: 0.172133 May 27 09:54:33.004055 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 602/1201] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:32 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:33.020163 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-750643b9-9a2d-4368-af29-4cc495c2c43a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:33.020901 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-750643b9-9a2d-4368-af29-4cc495c2c43a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:33.027641 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-750643b9-9a2d-4368-af29-4cc495c2c43a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:33.028093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-750643b9-9a2d-4368-af29-4cc495c2c43a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:33.028860 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-750643b9-9a2d-4368-af29-4cc495c2c43a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:33.029302 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-750643b9-9a2d-4368-af29-4cc495c2c43a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:33.172090 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-750643b9-9a2d-4368-af29-4cc495c2c43a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:33.179578 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-750643b9-9a2d-4368-af29-4cc495c2c43a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1451 microversion: 2.1 time: 0.163713 May 27 09:54:33.180236 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 600/1202] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:54:33 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:35.426387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-1d4b803e-9c46-4a05-a71f-a26ea22ce210 req-67dc6901-efbf-4b97-893f-7a82799dc155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe94756-b459-402b-ae34-6c33212dbfeb", "tag": "a5872eee-9e8c-4b27-9455-b29cc8304599"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:35.435208 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-1d4b803e-9c46-4a05-a71f-a26ea22ce210 req-67dc6901-efbf-4b97-893f-7a82799dc155 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:35.435768 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-1d4b803e-9c46-4a05-a71f-a26ea22ce210 req-67dc6901-efbf-4b97-893f-7a82799dc155 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:35.446628 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-1d4b803e-9c46-4a05-a71f-a26ea22ce210 req-67dc6901-efbf-4b97-893f-7a82799dc155 service nova] Creating event network-changed:a5872eee-9e8c-4b27-9455-b29cc8304599 for instance 7fe94756-b459-402b-ae34-6c33212dbfeb on hv-cinder-79760 May 27 09:54:35.451746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-1d4b803e-9c46-4a05-a71f-a26ea22ce210 req-67dc6901-efbf-4b97-893f-7a82799dc155 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029398 May 27 09:54:35.452545 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 603/1203] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:55:48.904257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=13 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:55:48.905001 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=78 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:55:48.909638 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d18b58cf-79cb-4f7f-b846-717020669a9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:55:48.910128 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d18b58cf-79cb-4f7f-b846-717020669a9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:55:48.916899 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d18b58cf-79cb-4f7f-b846-717020669a9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:48.917344 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d18b58cf-79cb-4f7f-b846-717020669a9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:48.918093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d18b58cf-79cb-4f7f-b846-717020669a9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:48.918521 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-d18b58cf-79cb-4f7f-b846-717020669a9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:48.940821 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d18b58cf-79cb-4f7f-b846-717020669a9a tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/ips" status: 200 len: 148 microversion: 2.1 time: 0.038504 May 27 09:55:48.941378 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 601/1204] 10.222.0.41 () {58 vars in 1247 bytes} [Fri May 27 09:55:48 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:55:50.245111 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=9 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:55:50.245847 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=52 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:55:50.250336 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ba054881-eb29-4183-b462-7407da33ce2d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e2b0a67-fc90-4a79-bdea-d857a1384237"}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:55:50.252122 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-ba054881-eb29-4183-b462-7407da33ce2d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:55:50.258987 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba054881-eb29-4183-b462-7407da33ce2d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:50.259466 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba054881-eb29-4183-b462-7407da33ce2d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:50.260221 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba054881-eb29-4183-b462-7407da33ce2d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:50.260655 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-ba054881-eb29-4183-b462-7407da33ce2d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:50.513958 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ba054881-eb29-4183-b462-7407da33ce2d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "POST /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270670 May 27 09:55:50.514561 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 604/1205] 10.222.0.41 () {60 vars in 1322 bytes} [Fri May 27 09:55:50 2022] POST /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:55:58.091847 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-6d7b095f-97d6-43a8-95e0-91212849a2b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:55:58.092377 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-6d7b095f-97d6-43a8-95e0-91212849a2b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:55:58.099427 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6d7b095f-97d6-43a8-95e0-91212849a2b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:58.099882 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6d7b095f-97d6-43a8-95e0-91212849a2b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:58.100648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6d7b095f-97d6-43a8-95e0-91212849a2b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:58.101084 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-6d7b095f-97d6-43a8-95e0-91212849a2b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:58.182776 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.objects.instance [None req-6d7b095f-97d6-43a8-95e0-91212849a2b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lazy-loading 'services' on Instance uuid 15a782e9-c458-440c-8c00-3ad1eb73ffdb {{(pid=129291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:55:58.251121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-6d7b095f-97d6-43a8-95e0-91212849a2b4 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/os-volume_attachments/5e2b0a67-fc90-4a79-bdea-d857a1384237" status: 202 len: 0 microversion: 2.1 time: 0.163063 May 27 09:55:58.251817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 602/1206] 10.222.0.41 () {58 vars in 1415 bytes} [Fri May 27 09:55:58 2022] DELETE /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/os-volume_attachments/5e2b0a67-fc90-4a79-bdea-d857a1384237 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:55:58.261404 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b5a7adc5-7637-4917-9854-9105e8ab26ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:55:58.262472 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b5a7adc5-7637-4917-9854-9105e8ab26ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:55:58.270296 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b5a7adc5-7637-4917-9854-9105e8ab26ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:58.270833 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b5a7adc5-7637-4917-9854-9105e8ab26ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:58.271925 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b5a7adc5-7637-4917-9854-9105e8ab26ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:58.272363 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b5a7adc5-7637-4917-9854-9105e8ab26ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:58.305560 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b5a7adc5-7637-4917-9854-9105e8ab26ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049046 May 27 09:55:58.306110 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 605/1207] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:55:58 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:55:59.319233 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-8c21e1df-a87d-47c6-9ce9-dc0d08a645c5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:55:59.320312 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-8c21e1df-a87d-47c6-9ce9-dc0d08a645c5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:55:59.326498 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c21e1df-a87d-47c6-9ce9-dc0d08a645c5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:59.326940 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c21e1df-a87d-47c6-9ce9-dc0d08a645c5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:59.327725 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c21e1df-a87d-47c6-9ce9-dc0d08a645c5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:59.328158 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-8c21e1df-a87d-47c6-9ce9-dc0d08a645c5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:59.355958 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-8c21e1df-a87d-47c6-9ce9-dc0d08a645c5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042264 May 27 09:55:59.356502 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 603/1208] 10.222.0.41 () {58 vars in 1301 bytes} [Fri May 27 09:55:59 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:55:59.413738 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-20cfe576-c9a9-45d2-b7f3-7449f428745b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:55:59.414228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-20cfe576-c9a9-45d2-b7f3-7449f428745b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:55:59.420639 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20cfe576-c9a9-45d2-b7f3-7449f428745b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:59.421088 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20cfe576-c9a9-45d2-b7f3-7449f428745b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:59.421851 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20cfe576-c9a9-45d2-b7f3-7449f428745b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:59.422291 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-20cfe576-c9a9-45d2-b7f3-7449f428745b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:59.448472 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-20cfe576-c9a9-45d2-b7f3-7449f428745b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Going to try to terminate instance {{(pid=129290) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:55:59.521207 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-20cfe576-c9a9-45d2-b7f3-7449f428745b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 204 len: 0 microversion: 2.1 time: 0.110956 May 27 09:55:59.521801 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 606/1209] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:55:59 2022] DELETE /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:55:59.530020 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3c1c4656-8f17-4274-ba99-dc839fc1d58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:55:59.530740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-3c1c4656-8f17-4274-ba99-dc839fc1d58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:55:59.537311 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3c1c4656-8f17-4274-ba99-dc839fc1d58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:59.537752 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3c1c4656-8f17-4274-ba99-dc839fc1d58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:59.538505 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3c1c4656-8f17-4274-ba99-dc839fc1d58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:55:59.538939 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-3c1c4656-8f17-4274-ba99-dc839fc1d58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:55:59.664748 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-3c1c4656-8f17-4274-ba99-dc839fc1d58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:55:59.672149 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3c1c4656-8f17-4274-ba99-dc839fc1d58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1681 microversion: 2.1 time: 0.146141 May 27 09:55:59.672737 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 604/1210] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:55:59 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:56:00.690247 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-0c925d05-ab69-47cc-9b7a-eb052e8673ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:00.691029 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-0c925d05-ab69-47cc-9b7a-eb052e8673ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:00.697658 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0c925d05-ab69-47cc-9b7a-eb052e8673ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:00.698099 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0c925d05-ab69-47cc-9b7a-eb052e8673ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:00.698854 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0c925d05-ab69-47cc-9b7a-eb052e8673ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:00.699294 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-0c925d05-ab69-47cc-9b7a-eb052e8673ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:00.828444 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-0c925d05-ab69-47cc-9b7a-eb052e8673ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:00.836781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-0c925d05-ab69-47cc-9b7a-eb052e8673ad tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1681 microversion: 2.1 time: 0.150781 May 27 09:56:00.837343 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 607/1211] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:00 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:01.853613 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dd323a70-4733-4e48-a8dc-56a487a88e70 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:01.854334 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dd323a70-4733-4e48-a8dc-56a487a88e70 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:01.860930 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd323a70-4733-4e48-a8dc-56a487a88e70 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:01.861443 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd323a70-4733-4e48-a8dc-56a487a88e70 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:01.862273 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd323a70-4733-4e48-a8dc-56a487a88e70 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:01.862793 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd323a70-4733-4e48-a8dc-56a487a88e70 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:02.065195 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dd323a70-4733-4e48-a8dc-56a487a88e70 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d96e9d955934f0e883df57a3bcf934d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43091208be574e6e8cc348667792f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:02.073445 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dd323a70-4733-4e48-a8dc-56a487a88e70 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 200 len: 1681 microversion: 2.1 time: 0.223656 May 27 09:56:02.074016 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 605/1212] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:01 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:02.556245 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-6cd342b9-1745-449b-af5b-4b16c83474c8 req-7cf51d22-7cb0-4e2e-bea9-7fa3a3827c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a782e9-c458-440c-8c00-3ad1eb73ffdb", "name": "network-vif-deleted", "tag": "3c0d0516-0cd6-4400-aa39-bbacf571ace1"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:56:02.566600 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-6cd342b9-1745-449b-af5b-4b16c83474c8 req-7cf51d22-7cb0-4e2e-bea9-7fa3a3827c3e service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:02.567353 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-6cd342b9-1745-449b-af5b-4b16c83474c8 req-7cf51d22-7cb0-4e2e-bea9-7fa3a3827c3e service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:02.581211 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-6cd342b9-1745-449b-af5b-4b16c83474c8 req-7cf51d22-7cb0-4e2e-bea9-7fa3a3827c3e service nova] Creating event network-vif-deleted:3c0d0516-0cd6-4400-aa39-bbacf571ace1 for instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb on hv-cinder-79760 May 27 09:56:02.587156 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-6cd342b9-1745-449b-af5b-4b16c83474c8 req-7cf51d22-7cb0-4e2e-bea9-7fa3a3827c3e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109913 May 27 09:56:02.591029 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 608/1213] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:03.090160 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-461616c0-4100-447c-a98d-bddba6b454d9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:03.090779 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-461616c0-4100-447c-a98d-bddba6b454d9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:03.098246 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-461616c0-4100-447c-a98d-bddba6b454d9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:03.098948 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-461616c0-4100-447c-a98d-bddba6b454d9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:03.099763 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-461616c0-4100-447c-a98d-bddba6b454d9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:03.100206 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-461616c0-4100-447c-a98d-bddba6b454d9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:03.113914 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-461616c0-4100-447c-a98d-bddba6b454d9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-461616c0-4100-447c-a98d-bddba6b454d9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb HTTP/1.1 May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:56:03.115605 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:03.117272 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '15a782e9-c458-440c-8c00-3ad1eb73ffdb'} May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:56:03.118121 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:03.119600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:03.120776 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-461616c0-4100-447c-a98d-bddba6b454d9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:56:03.120776 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-461616c0-4100-447c-a98d-bddba6b454d9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 404 len: 111 microversion: 2.1 time: 0.030988 May 27 09:56:03.120776 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 606/1214] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:03 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:56:03.126630 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-7372af0d-935e-4bff-9411-fda57518d485 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '.version_select at 0x7f188c365e50>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:03.144749 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-7372af0d-935e-4bff-9411-fda57518d485 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227222033" status: 202 len: 0 microversion: 2.1 time: 0.022232 May 27 09:56:03.145515 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 609/1215] 10.222.0.41 () {58 vars in 1220 bytes} [Fri May 27 09:56:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227222033 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:56:04.883254 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-693332a6-761a-41d9-a182-bdd9f2549182 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:04.883750 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-693332a6-761a-41d9-a182-bdd9f2549182 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:04.890066 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-693332a6-761a-41d9-a182-bdd9f2549182 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:04.890505 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-693332a6-761a-41d9-a182-bdd9f2549182 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:04.891257 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-693332a6-761a-41d9-a182-bdd9f2549182 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:04.891742 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-693332a6-761a-41d9-a182-bdd9f2549182 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:04.904600 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-693332a6-761a-41d9-a182-bdd9f2549182 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-693332a6-761a-41d9-a182-bdd9f2549182 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb HTTP/1.1 May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:56:04.906150 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:04.907702 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '15a782e9-c458-440c-8c00-3ad1eb73ffdb'} May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:56:04.908489 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:04.910265 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:04.911577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-693332a6-761a-41d9-a182-bdd9f2549182 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:56:04.911577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-693332a6-761a-41d9-a182-bdd9f2549182 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 404 len: 111 microversion: 2.1 time: 0.028013 May 27 09:56:04.911577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 607/1216] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:56:04 2022] DELETE /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:56:04.916692 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-21159026-ea74-41d6-a368-686d40b55eb5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:04.917410 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-21159026-ea74-41d6-a368-686d40b55eb5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 15a782e9-c458-440c-8c00-3ad1eb73ffdb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:04.923534 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-21159026-ea74-41d6-a368-686d40b55eb5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:04.923979 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-21159026-ea74-41d6-a368-686d40b55eb5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:04.924727 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-21159026-ea74-41d6-a368-686d40b55eb5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:04.925806 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-21159026-ea74-41d6-a368-686d40b55eb5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:04.938518 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-21159026-ea74-41d6-a368-686d40b55eb5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-21159026-ea74-41d6-a368-686d40b55eb5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb HTTP/1.1 May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:56:04.940105 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:04.941750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '15a782e9-c458-440c-8c00-3ad1eb73ffdb'} May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:56:04.942651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. May 27 09:56:04.944140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:04.945412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-21159026-ea74-41d6-a368-686d40b55eb5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 15a782e9-c458-440c-8c00-3ad1eb73ffdb could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:56:04.945412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-21159026-ea74-41d6-a368-686d40b55eb5 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb" status: 404 len: 111 microversion: 2.1 time: 0.029049 May 27 09:56:04.945412 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 610/1217] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:04 2022] GET /compute/v2.1/servers/15a782e9-c458-440c-8c00-3ad1eb73ffdb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:56:06.073269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4da9a398-0895-4538-82bd-81938fa5a58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:06.073767 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4da9a398-0895-4538-82bd-81938fa5a58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:06.080211 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4da9a398-0895-4538-82bd-81938fa5a58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:06.080661 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4da9a398-0895-4538-82bd-81938fa5a58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:06.081438 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4da9a398-0895-4538-82bd-81938fa5a58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:06.081877 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4da9a398-0895-4538-82bd-81938fa5a58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:06.095054 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-4da9a398-0895-4538-82bd-81938fa5a58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4da9a398-0895-4538-82bd-81938fa5a58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 HTTP/1.1 May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:56:06.096635 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:56:06.098291 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '670d7a28-aa3d-47d5-aa4e-d5701879d778'} May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:56:06.099169 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:56:06.100657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:06.102211 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4da9a398-0895-4538-82bd-81938fa5a58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:56:06.102211 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4da9a398-0895-4538-82bd-81938fa5a58b tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 404 len: 111 microversion: 2.1 time: 0.028582 May 27 09:56:06.102211 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 608/1218] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:56:06 2022] DELETE /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:56:06.106089 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5c72cd28-0e4c-4695-8458-c56ca486250d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:06.106697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5c72cd28-0e4c-4695-8458-c56ca486250d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 670d7a28-aa3d-47d5-aa4e-d5701879d778] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:06.113631 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5c72cd28-0e4c-4695-8458-c56ca486250d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:06.114079 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5c72cd28-0e4c-4695-8458-c56ca486250d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:06.114837 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5c72cd28-0e4c-4695-8458-c56ca486250d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:06.115269 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5c72cd28-0e4c-4695-8458-c56ca486250d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:06.128963 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-5c72cd28-0e4c-4695-8458-c56ca486250d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5c72cd28-0e4c-4695-8458-c56ca486250d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 HTTP/1.1 May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:56:06.130456 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:56:06.132076 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '670d7a28-aa3d-47d5-aa4e-d5701879d778'} May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:56:06.133167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. May 27 09:56:06.134697 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:06.136383 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5c72cd28-0e4c-4695-8458-c56ca486250d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 670d7a28-aa3d-47d5-aa4e-d5701879d778 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:56:06.136383 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5c72cd28-0e4c-4695-8458-c56ca486250d tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778" status: 404 len: 111 microversion: 2.1 time: 0.029514 May 27 09:56:06.136383 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 611/1219] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:06 2022] GET /compute/v2.1/servers/670d7a28-aa3d-47d5-aa4e-d5701879d778 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:56:06.139824 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-140f8616-1352-4a41-82ec-a3971786c0f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:06.140395 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-140f8616-1352-4a41-82ec-a3971786c0f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:06.146238 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-140f8616-1352-4a41-82ec-a3971786c0f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:06.146687 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-140f8616-1352-4a41-82ec-a3971786c0f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:06.147480 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-140f8616-1352-4a41-82ec-a3971786c0f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:06.147915 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-140f8616-1352-4a41-82ec-a3971786c0f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:06.161648 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-140f8616-1352-4a41-82ec-a3971786c0f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-140f8616-1352-4a41-82ec-a3971786c0f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 HTTP/1.1 May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:56:06.163185 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:56:06.164849 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1'} May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:56:06.165839 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:56:06.167365 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:06.169091 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-140f8616-1352-4a41-82ec-a3971786c0f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:56:06.169091 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-140f8616-1352-4a41-82ec-a3971786c0f9 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 404 len: 111 microversion: 2.1 time: 0.028425 May 27 09:56:06.169091 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 609/1220] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:56:06 2022] DELETE /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:56:06.172539 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-72918871-11d2-4bbd-8e51-8e79266ebe14 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:06.173147 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-72918871-11d2-4bbd-8e51-8e79266ebe14 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:06.179660 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72918871-11d2-4bbd-8e51-8e79266ebe14 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:06.180102 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72918871-11d2-4bbd-8e51-8e79266ebe14 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:06.180855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72918871-11d2-4bbd-8e51-8e79266ebe14 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:06.181282 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-72918871-11d2-4bbd-8e51-8e79266ebe14 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:06.194148 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-72918871-11d2-4bbd-8e51-8e79266ebe14 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-72918871-11d2-4bbd-8e51-8e79266ebe14 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 HTTP/1.1 May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:56:06.195646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:56:06.197646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1'} May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:56:06.198996 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. May 27 09:56:06.201140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:06.202643 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-72918871-11d2-4bbd-8e51-8e79266ebe14 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:56:06.202643 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-72918871-11d2-4bbd-8e51-8e79266ebe14 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1" status: 404 len: 111 microversion: 2.1 time: 0.028155 May 27 09:56:06.202643 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 612/1221] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:06 2022] GET /compute/v2.1/servers/1aea4a5e-0bef-446f-b944-bc4b7b3c9ee1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:56:07.330170 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fb35f907-0adf-46fe-98d4-5251de43ec22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:07.330676 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-fb35f907-0adf-46fe-98d4-5251de43ec22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:07.336861 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb35f907-0adf-46fe-98d4-5251de43ec22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:07.337306 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb35f907-0adf-46fe-98d4-5251de43ec22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:07.338089 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb35f907-0adf-46fe-98d4-5251de43ec22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:07.338519 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-fb35f907-0adf-46fe-98d4-5251de43ec22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:07.351500 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-fb35f907-0adf-46fe-98d4-5251de43ec22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fb35f907-0adf-46fe-98d4-5251de43ec22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f HTTP/1.1 May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:56:07.353003 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:56:07.354608 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': '2e2f121d-c06c-46e0-9e8b-455c50a5866f'} May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:56:07.355714 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:56:07.357231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:56:07.358873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-fb35f907-0adf-46fe-98d4-5251de43ec22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:56:07.358873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-fb35f907-0adf-46fe-98d4-5251de43ec22 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 404 len: 111 microversion: 2.1 time: 0.028117 May 27 09:56:07.358873 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 610/1222] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:56:07 2022] DELETE /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:56:07.362998 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9fd482bc-2324-46a2-b949-abc3cbda4d42 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:07.363678 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9fd482bc-2324-46a2-b949-abc3cbda4d42 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] [instance: 2e2f121d-c06c-46e0-9e8b-455c50a5866f] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:07.370166 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9fd482bc-2324-46a2-b949-abc3cbda4d42 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:07.370613 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9fd482bc-2324-46a2-b949-abc3cbda4d42 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:07.371435 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9fd482bc-2324-46a2-b949-abc3cbda4d42 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:07.371872 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9fd482bc-2324-46a2-b949-abc3cbda4d42 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:07.385467 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-9fd482bc-2324-46a2-b949-abc3cbda4d42 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] HTTP exception thrown: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9fd482bc-2324-46a2-b949-abc3cbda4d42 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Request method failure captured: May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f HTTP/1.1 May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ5NMg7WdGuybWGL5AoTRhYLnHS_kKomiQ6BytkjROMSgfcohYnDOiNmvmORAaTDbTZVrQc4Jc0hHngYk3LHtd6OkD2EC--_Cd5CeF6m1Y7qQwlezeEdtVaVwm1okrXWDC9JEImjquCIIaEqAfbZXqQxV5_pSSRYpUFR_wP4Ftak6dk May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:56:07.386942 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43091208be574e6e8cc348667792f751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43091208be574e6e8cc348667792f751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43091208be574e6e8cc348667792f751"}]}] May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 43091208be574e6e8cc348667792f751 May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2003459995 May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: 8d96e9d955934f0e883df57a3bcf934d May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-AttachVolumeNegativeTest-2003459995-project May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:56:07.388580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '2e2f121d-c06c-46e0-9e8b-455c50a5866f'} May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:56:07.389500 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. May 27 09:56:07.390959 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:56:07.392288 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9fd482bc-2324-46a2-b949-abc3cbda4d42 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] Returning 404 to user: Instance 2e2f121d-c06c-46e0-9e8b-455c50a5866f could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:56:07.392288 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9fd482bc-2324-46a2-b949-abc3cbda4d42 tempest-AttachVolumeNegativeTest-2003459995 tempest-AttachVolumeNegativeTest-2003459995-project] 10.222.0.41 "GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f" status: 404 len: 111 microversion: 2.1 time: 0.029708 May 27 09:56:07.392288 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 613/1223] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:07 2022] GET /compute/v2.1/servers/2e2f121d-c06c-46e0-9e8b-455c50a5866f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:56:13.010089 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-9867da14-08f1-4b2e-8455-24744ab6268a tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f1890a8f700>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:13.057983 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-9867da14-08f1-4b2e-8455-24744ab6268a tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/318f4498-3fa6-4d42-982b-2e479abbbe21" status: 200 len: 350 microversion: 2.1 time: 0.051600 May 27 09:56:13.058567 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 611/1224] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:56:13 2022] GET /compute/v2.1/os-volumes/318f4498-3fa6-4d42-982b-2e479abbbe21 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:14.369178 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-bac5e930-ed42-4641-b11f-fc365a5f8841 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f188c545dc0>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:14.416252 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-bac5e930-ed42-4641-b11f-fc365a5f8841 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/c081b9ed-2e5e-40f9-9382-bd1e8aa27294" status: 200 len: 351 microversion: 2.1 time: 0.050819 May 27 09:56:14.416805 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 614/1225] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:56:14 2022] GET /compute/v2.1/os-volumes/c081b9ed-2e5e-40f9-9382-bd1e8aa27294 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:15.730438 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-b3bd5c5d-c665-4d75-96c9-2d0c30f8c352 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f188c10b790>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:15.775935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-b3bd5c5d-c665-4d75-96c9-2d0c30f8c352 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/add9f2e7-b500-41a1-adab-3234bbd33227" status: 200 len: 351 microversion: 2.1 time: 0.049700 May 27 09:56:15.776494 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 612/1226] 10.222.0.41 () {58 vars in 1244 bytes} [Fri May 27 09:56:15 2022] GET /compute/v2.1/os-volumes/add9f2e7-b500-41a1-adab-3234bbd33227 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:15.788290 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2ff0b305-27d0-4b6e-9edf-b126e50b19e7 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f188c04b430>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:15.868199 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2ff0b305-27d0-4b6e-9edf-b126e50b19e7 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084715 May 27 09:56:15.868759 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 615/1227] 10.222.0.41 () {58 vars in 1133 bytes} [Fri May 27 09:56:15 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:15.880853 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5b775c89-95d4-4888-8789-4a52fd71dbf6 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f1890a74280>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:15.962264 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5b775c89-95d4-4888-8789-4a52fd71dbf6 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085537 May 27 09:56:15.962830 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 613/1228] 10.222.0.41 () {58 vars in 1148 bytes} [Fri May 27 09:56:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:15.974178 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-ee4c4027-2366-4235-8366-2e3d29ea0981 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f188c04b280>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:16.062208 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-ee4c4027-2366-4235-8366-2e3d29ea0981 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091680 May 27 09:56:16.062774 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 616/1229] 10.222.0.41 () {58 vars in 1133 bytes} [Fri May 27 09:56:15 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:16.074279 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-276f43d9-3f87-4f4e-8b77-ea2405f5024d tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f1890a8f670>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:16.154410 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-276f43d9-3f87-4f4e-8b77-ea2405f5024d tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083829 May 27 09:56:16.155007 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 614/1230] 10.222.0.41 () {58 vars in 1166 bytes} [Fri May 27 09:56:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:16.166714 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2563d8ce-37b1-4949-a090-84fb3468fa4b tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f188c23fca0>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:16.433344 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2563d8ce-37b1-4949-a090-84fb3468fa4b tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.270218 May 27 09:56:16.433923 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 617/1231] 10.222.0.41 () {58 vars in 1169 bytes} [Fri May 27 09:56:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:16.446362 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-96cda5ea-920b-47c0-9a83-6695bcc62833 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f188c2e1dc0>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:16.523433 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-96cda5ea-920b-47c0-9a83-6695bcc62833 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.080752 May 27 09:56:16.524006 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 615/1232] 10.222.0.41 () {58 vars in 1154 bytes} [Fri May 27 09:56:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:16.534836 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-31a0bb98-4518-46d2-8924-285ca5905cb3 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f188c284310>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:16.616474 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-31a0bb98-4518-46d2-8924-285ca5905cb3 tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085269 May 27 09:56:16.617034 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 618/1233] 10.222.0.41 () {58 vars in 1187 bytes} [Fri May 27 09:56:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:16.628797 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ff7cf0f7-e074-4faf-a846-ddb3ef2466bf tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] Calling method '.version_select at 0x7f1890a741f0>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:16.709850 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ff7cf0f7-e074-4faf-a846-ddb3ef2466bf tempest-VolumesTestJSON-405119519 tempest-VolumesTestJSON-405119519-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085302 May 27 09:56:16.710419 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 616/1234] 10.222.0.41 () {58 vars in 1154 bytes} [Fri May 27 09:56:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:39.790813 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:39.791599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:39.795845 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1331723488", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-830294606", "security_groups": [{"name": "tempest-secgroup-smoke-861602896"}], "block_device_mapping_v2": [{"uuid": "d3e1f834-56ab-4a86-b3d9-69e99da78425", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f077ba7a-e018-4516-8e3d-23ac2b5e2506"}]}} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:56:39.915842 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.network.neutron [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] validate_networks() for [('f077ba7a-e018-4516-8e3d-23ac2b5e2506', None, None, None, None, None)] {{(pid=129290) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:56:40.297341 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Flavor limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:56:40.297882 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Image limits 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:56:40.298427 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Flavor pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:56:40.298929 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Image pref 0:0:0 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:56:40.299446 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.virt.hardware [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:56:40.308229 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:40.308767 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:40.309638 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:40.310144 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:40.327543 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Getting quotas for project 0fb2f335c9b540af8f7119c85656efad. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:56:40.331447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.quota [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Getting quotas for user f1fa5f1765ed4995b31a1600ce3edb07 and project 0fb2f335c9b540af8f7119c85656efad. Resources: {'instances', 'ram', 'cores'} {{(pid=129290) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:56:40.390651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Going to run 1 instances... {{(pid=129290) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:56:40.392981 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3e1f834-56ab-4a86-b3d9-69e99da78425',volume_size=None,volume_type=None)] {{(pid=129290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:56:40.529008 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-afc90a4e-ba61-4a31-afa5-6461453334c6 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.739282 May 27 09:56:40.529649 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 619/1235] 10.222.0.41 () {60 vars in 1146 bytes} [Fri May 27 09:56:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:56:40.536994 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=20 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:40.537750 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:40.541840 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-d684f48e-9953-472d-823e-dd00bf589437 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:40.542446 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-d684f48e-9953-472d-823e-dd00bf589437 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:40.598777 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-d684f48e-9953-472d-823e-dd00bf589437 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:40.605663 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-d684f48e-9953-472d-823e-dd00bf589437 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1094 microversion: 2.1 time: 0.069987 May 27 09:56:40.606246 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 617/1236] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:40 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:41.626333 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-79d80f12-60e1-4d89-954b-2340ed2c1a7a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:41.627125 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-79d80f12-60e1-4d89-954b-2340ed2c1a7a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:41.639314 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-79d80f12-60e1-4d89-954b-2340ed2c1a7a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:41.639782 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-79d80f12-60e1-4d89-954b-2340ed2c1a7a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:41.640976 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-79d80f12-60e1-4d89-954b-2340ed2c1a7a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:41.641609 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-79d80f12-60e1-4d89-954b-2340ed2c1a7a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:41.711089 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-79d80f12-60e1-4d89-954b-2340ed2c1a7a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:41.720124 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-79d80f12-60e1-4d89-954b-2340ed2c1a7a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1210 microversion: 2.1 time: 0.102029 May 27 09:56:41.730725 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 620/1237] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:41 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:42.738898 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-c0f7bd09-4ea8-4ea4-a91a-bdbcac99d4b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:42.739544 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-c0f7bd09-4ea8-4ea4-a91a-bdbcac99d4b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:42.747541 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c0f7bd09-4ea8-4ea4-a91a-bdbcac99d4b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:42.747977 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c0f7bd09-4ea8-4ea4-a91a-bdbcac99d4b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:42.748755 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c0f7bd09-4ea8-4ea4-a91a-bdbcac99d4b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:42.749196 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-c0f7bd09-4ea8-4ea4-a91a-bdbcac99d4b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:42.968488 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-c0f7bd09-4ea8-4ea4-a91a-bdbcac99d4b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:42.987878 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-c0f7bd09-4ea8-4ea4-a91a-bdbcac99d4b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.243600 May 27 09:56:42.987878 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 618/1238] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:42 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:43.116303 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [req-7826b03d-f457-465b-b6b3-bf9d1d08eff8 req-7a0176bc-1c7a-4ce5-8202-77e491f1f372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c255f085-3c23-4a90-86d9-6c4514cc89bd", "tag": "942d0152-92a5-4da9-8fdc-b859b499fcfe"}]} {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:56:43.133093 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-7826b03d-f457-465b-b6b3-bf9d1d08eff8 req-7a0176bc-1c7a-4ce5-8202-77e491f1f372 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:43.133556 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [req-7826b03d-f457-465b-b6b3-bf9d1d08eff8 req-7a0176bc-1c7a-4ce5-8202-77e491f1f372 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:43.153911 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.compute.server_external_events [req-7826b03d-f457-465b-b6b3-bf9d1d08eff8 req-7a0176bc-1c7a-4ce5-8202-77e491f1f372 service nova] Creating event network-changed:942d0152-92a5-4da9-8fdc-b859b499fcfe for instance c255f085-3c23-4a90-86d9-6c4514cc89bd on hv-cinder-79760 May 27 09:56:43.160368 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [req-7826b03d-f457-465b-b6b3-bf9d1d08eff8 req-7a0176bc-1c7a-4ce5-8202-77e491f1f372 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051156 May 27 09:56:43.161140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 621/1239] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:43.995718 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-991049b0-3029-4f59-afe5-d1398cf25c1e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:43.996326 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-991049b0-3029-4f59-afe5-d1398cf25c1e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:44.002791 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-991049b0-3029-4f59-afe5-d1398cf25c1e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:44.003233 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-991049b0-3029-4f59-afe5-d1398cf25c1e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:44.004040 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-991049b0-3029-4f59-afe5-d1398cf25c1e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:44.004473 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-991049b0-3029-4f59-afe5-d1398cf25c1e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:44.131241 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-991049b0-3029-4f59-afe5-d1398cf25c1e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:44.138995 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-991049b0-3029-4f59-afe5-d1398cf25c1e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.147167 May 27 09:56:44.139603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 619/1240] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:43 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:45.155693 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b9b8f56f-3b35-41bc-9252-92929dc9afcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:45.156303 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b9b8f56f-3b35-41bc-9252-92929dc9afcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:45.162916 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b9b8f56f-3b35-41bc-9252-92929dc9afcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:45.163388 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b9b8f56f-3b35-41bc-9252-92929dc9afcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:45.164146 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b9b8f56f-3b35-41bc-9252-92929dc9afcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:45.164580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b9b8f56f-3b35-41bc-9252-92929dc9afcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:45.290236 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-b9b8f56f-3b35-41bc-9252-92929dc9afcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:45.297574 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b9b8f56f-3b35-41bc-9252-92929dc9afcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.146299 May 27 09:56:45.298133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 622/1241] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:45 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:46.314723 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-ee63cf6a-51b4-49b1-b77a-7fff2b1599ff tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:46.315390 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-ee63cf6a-51b4-49b1-b77a-7fff2b1599ff tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:46.322335 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ee63cf6a-51b4-49b1-b77a-7fff2b1599ff tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:46.322732 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ee63cf6a-51b4-49b1-b77a-7fff2b1599ff tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:46.323532 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ee63cf6a-51b4-49b1-b77a-7fff2b1599ff tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:46.323976 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-ee63cf6a-51b4-49b1-b77a-7fff2b1599ff tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:46.453281 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-ee63cf6a-51b4-49b1-b77a-7fff2b1599ff tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:46.461660 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-ee63cf6a-51b4-49b1-b77a-7fff2b1599ff tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.150815 May 27 09:56:46.462232 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 620/1242] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:46 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:47.478010 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-9ffa0065-3292-4adc-a3f4-743f8092c43d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:47.478651 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-9ffa0065-3292-4adc-a3f4-743f8092c43d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:47.484599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ffa0065-3292-4adc-a3f4-743f8092c43d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:47.485045 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ffa0065-3292-4adc-a3f4-743f8092c43d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:47.485797 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ffa0065-3292-4adc-a3f4-743f8092c43d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:47.486228 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-9ffa0065-3292-4adc-a3f4-743f8092c43d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:47.612462 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-9ffa0065-3292-4adc-a3f4-743f8092c43d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:47.620338 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-9ffa0065-3292-4adc-a3f4-743f8092c43d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.146357 May 27 09:56:47.620902 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 623/1243] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:47 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:56:48.637755 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5b49226c-9555-4c3a-8755-38e84850fd8b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:48.638310 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5b49226c-9555-4c3a-8755-38e84850fd8b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:48.645309 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5b49226c-9555-4c3a-8755-38e84850fd8b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:48.645750 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5b49226c-9555-4c3a-8755-38e84850fd8b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:48.646506 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5b49226c-9555-4c3a-8755-38e84850fd8b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:48.646935 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5b49226c-9555-4c3a-8755-38e84850fd8b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:48.775514 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5b49226c-9555-4c3a-8755-38e84850fd8b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:48.782840 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5b49226c-9555-4c3a-8755-38e84850fd8b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.149067 May 27 09:56:48.783425 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 621/1244] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:48 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:49.799401 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-54907543-e098-4ab6-9e9b-689add98986a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:49.800018 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-54907543-e098-4ab6-9e9b-689add98986a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:49.806883 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54907543-e098-4ab6-9e9b-689add98986a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:49.807374 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54907543-e098-4ab6-9e9b-689add98986a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:49.808140 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54907543-e098-4ab6-9e9b-689add98986a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:49.808580 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-54907543-e098-4ab6-9e9b-689add98986a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:49.934704 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-54907543-e098-4ab6-9e9b-689add98986a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:49.942166 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-54907543-e098-4ab6-9e9b-689add98986a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.146602 May 27 09:56:49.943260 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 624/1245] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:49 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:50.960040 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-684a142d-8096-43a2-a0d6-a8458ecb5a5b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:50.960904 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-684a142d-8096-43a2-a0d6-a8458ecb5a5b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:50.963218 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell0:SELECT=2 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:50.968647 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-684a142d-8096-43a2-a0d6-a8458ecb5a5b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:50.969093 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-684a142d-8096-43a2-a0d6-a8458ecb5a5b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:50.969851 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-684a142d-8096-43a2-a0d6-a8458ecb5a5b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:50.970292 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-684a142d-8096-43a2-a0d6-a8458ecb5a5b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:51.101452 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-684a142d-8096-43a2-a0d6-a8458ecb5a5b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:51.108811 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-684a142d-8096-43a2-a0d6-a8458ecb5a5b tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.153376 May 27 09:56:51.109411 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 622/1246] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:50 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:52.126479 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1c0d4945-6896-43f1-877c-132c509e5688 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:52.127167 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1c0d4945-6896-43f1-877c-132c509e5688 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:52.129004 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=2 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:52.130387 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell0:SELECT=6 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:52.136634 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1c0d4945-6896-43f1-877c-132c509e5688 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:52.137082 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1c0d4945-6896-43f1-877c-132c509e5688 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:52.137833 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1c0d4945-6896-43f1-877c-132c509e5688 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:52.138264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1c0d4945-6896-43f1-877c-132c509e5688 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:52.263981 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1c0d4945-6896-43f1-877c-132c509e5688 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:52.271382 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1c0d4945-6896-43f1-877c-132c509e5688 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.148806 May 27 09:56:52.271944 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 625/1247] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:52 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:53.288245 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a17cd6b5-87b7-4b9d-a578-381ebc0d0078 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:53.288855 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a17cd6b5-87b7-4b9d-a578-381ebc0d0078 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:53.295334 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a17cd6b5-87b7-4b9d-a578-381ebc0d0078 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:53.295786 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a17cd6b5-87b7-4b9d-a578-381ebc0d0078 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:53.296549 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a17cd6b5-87b7-4b9d-a578-381ebc0d0078 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:53.296990 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a17cd6b5-87b7-4b9d-a578-381ebc0d0078 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:53.429222 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-a17cd6b5-87b7-4b9d-a578-381ebc0d0078 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:53.437031 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a17cd6b5-87b7-4b9d-a578-381ebc0d0078 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.152724 May 27 09:56:53.437697 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 623/1248] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:53 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:54.453828 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-987fc469-9f5a-46b8-9821-ddd32d5a08fb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:54.454339 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-987fc469-9f5a-46b8-9821-ddd32d5a08fb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:54.461469 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-987fc469-9f5a-46b8-9821-ddd32d5a08fb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:54.461915 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-987fc469-9f5a-46b8-9821-ddd32d5a08fb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:54.462675 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-987fc469-9f5a-46b8-9821-ddd32d5a08fb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:54.463106 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-987fc469-9f5a-46b8-9821-ddd32d5a08fb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:54.595039 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-987fc469-9f5a-46b8-9821-ddd32d5a08fb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:54.603327 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-987fc469-9f5a-46b8-9821-ddd32d5a08fb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.153199 May 27 09:56:54.603905 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 626/1249] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:54 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:55.620729 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-f3d568cf-52ea-47cd-9d4d-1f2031027b66 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:55.621360 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-f3d568cf-52ea-47cd-9d4d-1f2031027b66 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:55.627791 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3d568cf-52ea-47cd-9d4d-1f2031027b66 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:55.628233 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3d568cf-52ea-47cd-9d4d-1f2031027b66 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:55.628988 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3d568cf-52ea-47cd-9d4d-1f2031027b66 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:55.629421 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-f3d568cf-52ea-47cd-9d4d-1f2031027b66 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:55.757762 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-f3d568cf-52ea-47cd-9d4d-1f2031027b66 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:55.765187 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-f3d568cf-52ea-47cd-9d4d-1f2031027b66 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.148280 May 27 09:56:55.765750 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 624/1250] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:55 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:56.781467 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-1f1e4298-4247-4f46-a31a-9f74d1934da1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:56.782078 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-1f1e4298-4247-4f46-a31a-9f74d1934da1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:56.789077 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1f1e4298-4247-4f46-a31a-9f74d1934da1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:56.789526 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1f1e4298-4247-4f46-a31a-9f74d1934da1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:56.790280 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1f1e4298-4247-4f46-a31a-9f74d1934da1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:56.790715 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-1f1e4298-4247-4f46-a31a-9f74d1934da1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:56.922562 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-1f1e4298-4247-4f46-a31a-9f74d1934da1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:56.931220 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-1f1e4298-4247-4f46-a31a-9f74d1934da1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.153470 May 27 09:56:56.931830 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 627/1251] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:56 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:57.949236 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-57dd7a03-250e-467c-8bba-98f7f8305c61 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:57.949854 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-57dd7a03-250e-467c-8bba-98f7f8305c61 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:57.956311 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-57dd7a03-250e-467c-8bba-98f7f8305c61 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:57.956765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-57dd7a03-250e-467c-8bba-98f7f8305c61 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:57.957537 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-57dd7a03-250e-467c-8bba-98f7f8305c61 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:57.957984 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-57dd7a03-250e-467c-8bba-98f7f8305c61 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:58.085601 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-57dd7a03-250e-467c-8bba-98f7f8305c61 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:58.093018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-57dd7a03-250e-467c-8bba-98f7f8305c61 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.147649 May 27 09:56:58.093586 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 625/1252] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:57 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:59.109292 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-3ac67393-5358-4952-ba0f-e8c34fe9c866 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:59.109902 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3ac67393-5358-4952-ba0f-e8c34fe9c866 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:59.116291 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3ac67393-5358-4952-ba0f-e8c34fe9c866 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:59.116736 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3ac67393-5358-4952-ba0f-e8c34fe9c866 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:59.117487 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3ac67393-5358-4952-ba0f-e8c34fe9c866 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:59.117921 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3ac67393-5358-4952-ba0f-e8c34fe9c866 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:59.244133 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-3ac67393-5358-4952-ba0f-e8c34fe9c866 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:59.251952 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3ac67393-5358-4952-ba0f-e8c34fe9c866 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.146444 May 27 09:56:59.252613 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 628/1253] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:56:59 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:59.786865 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-43bfd577-d280-48b5-9784-198bbae17d17 req-d8efec8f-d5c0-4094-9d18-003aa79ab9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c255f085-3c23-4a90-86d9-6c4514cc89bd", "name": "network-vif-plugged", "status": "completed", "tag": "942d0152-92a5-4da9-8fdc-b859b499fcfe"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:56:59.794894 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-43bfd577-d280-48b5-9784-198bbae17d17 req-d8efec8f-d5c0-4094-9d18-003aa79ab9f2 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:59.795363 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-43bfd577-d280-48b5-9784-198bbae17d17 req-d8efec8f-d5c0-4094-9d18-003aa79ab9f2 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:59.806644 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-43bfd577-d280-48b5-9784-198bbae17d17 req-d8efec8f-d5c0-4094-9d18-003aa79ab9f2 service nova] Creating event network-vif-plugged:942d0152-92a5-4da9-8fdc-b859b499fcfe for instance c255f085-3c23-4a90-86d9-6c4514cc89bd on hv-cinder-79760 May 27 09:56:59.811720 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-43bfd577-d280-48b5-9784-198bbae17d17 req-d8efec8f-d5c0-4094-9d18-003aa79ab9f2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149349 May 27 09:56:59.812300 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 626/1254] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:57:00.269330 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-74d095af-c66e-4148-be43-b0e9b8a59204 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:57:00.269973 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-74d095af-c66e-4148-be43-b0e9b8a59204 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:57:00.276876 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-74d095af-c66e-4148-be43-b0e9b8a59204 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:00.277321 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-74d095af-c66e-4148-be43-b0e9b8a59204 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:00.278075 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-74d095af-c66e-4148-be43-b0e9b8a59204 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:00.278503 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-74d095af-c66e-4148-be43-b0e9b8a59204 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:00.414202 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-74d095af-c66e-4148-be43-b0e9b8a59204 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:57:00.421750 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-74d095af-c66e-4148-be43-b0e9b8a59204 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.156315 May 27 09:57:00.422310 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 629/1255] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:57:00 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:57:01.440059 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-5f9dd0bd-12dd-458e-adc4-a15ae5aea2b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:57:01.440823 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-5f9dd0bd-12dd-458e-adc4-a15ae5aea2b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:57:01.447545 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5f9dd0bd-12dd-458e-adc4-a15ae5aea2b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:01.447991 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5f9dd0bd-12dd-458e-adc4-a15ae5aea2b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:01.448747 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5f9dd0bd-12dd-458e-adc4-a15ae5aea2b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:01.449179 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-5f9dd0bd-12dd-458e-adc4-a15ae5aea2b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:01.576587 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-5f9dd0bd-12dd-458e-adc4-a15ae5aea2b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:57:01.584629 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-5f9dd0bd-12dd-458e-adc4-a15ae5aea2b4 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.149436 May 27 09:57:01.585189 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 627/1256] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:57:01 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:57:02.602347 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-5d965059-8ed9-4df5-8b1b-2cd87649e084 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:57:02.602931 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-5d965059-8ed9-4df5-8b1b-2cd87649e084 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:57:02.609452 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5d965059-8ed9-4df5-8b1b-2cd87649e084 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:02.609892 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5d965059-8ed9-4df5-8b1b-2cd87649e084 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:02.610646 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5d965059-8ed9-4df5-8b1b-2cd87649e084 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:02.611079 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-5d965059-8ed9-4df5-8b1b-2cd87649e084 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:02.736760 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-5d965059-8ed9-4df5-8b1b-2cd87649e084 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:57:02.744121 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-5d965059-8ed9-4df5-8b1b-2cd87649e084 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.146221 May 27 09:57:02.744684 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 630/1257] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:57:02 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:57:03.760700 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-4d36fccf-bf8a-42be-8ba0-2d34dee9b4f1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:57:03.761297 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-4d36fccf-bf8a-42be-8ba0-2d34dee9b4f1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:57:03.767719 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4d36fccf-bf8a-42be-8ba0-2d34dee9b4f1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:03.768164 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4d36fccf-bf8a-42be-8ba0-2d34dee9b4f1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:03.768920 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4d36fccf-bf8a-42be-8ba0-2d34dee9b4f1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:03.769393 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-4d36fccf-bf8a-42be-8ba0-2d34dee9b4f1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:03.899389 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-4d36fccf-bf8a-42be-8ba0-2d34dee9b4f1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:57:03.906797 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-4d36fccf-bf8a-42be-8ba0-2d34dee9b4f1 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.149971 May 27 09:57:03.907388 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 628/1258] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:57:03 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:57:04.924007 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-cb75754f-cf51-4ccb-b342-1bca4f134cbb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:57:04.924594 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-cb75754f-cf51-4ccb-b342-1bca4f134cbb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:57:04.931084 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb75754f-cf51-4ccb-b342-1bca4f134cbb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:04.931568 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb75754f-cf51-4ccb-b342-1bca4f134cbb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:04.932328 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb75754f-cf51-4ccb-b342-1bca4f134cbb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:04.932757 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-cb75754f-cf51-4ccb-b342-1bca4f134cbb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:05.067417 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-cb75754f-cf51-4ccb-b342-1bca4f134cbb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:57:05.075117 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-cb75754f-cf51-4ccb-b342-1bca4f134cbb tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1265 microversion: 2.1 time: 0.154913 May 27 09:57:05.075728 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 631/1259] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:57:04 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:57:06.092603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-22de2df7-15bc-4944-9056-badbc9e967c8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:57:06.093428 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-22de2df7-15bc-4944-9056-badbc9e967c8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:57:06.100164 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-22de2df7-15bc-4944-9056-badbc9e967c8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:06.100626 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-22de2df7-15bc-4944-9056-badbc9e967c8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:06.101399 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-22de2df7-15bc-4944-9056-badbc9e967c8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:06.101841 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-22de2df7-15bc-4944-9056-badbc9e967c8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:06.231719 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-22de2df7-15bc-4944-9056-badbc9e967c8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:57:06.239774 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-22de2df7-15bc-4944-9056-badbc9e967c8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1452 microversion: 2.1 time: 0.150980 May 27 09:57:06.240499 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 629/1260] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:57:06 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:57:06.257248 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-105588f7-eed6-438d-bd48-246cad56bfcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:57:06.257871 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-105588f7-eed6-438d-bd48-246cad56bfcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:57:06.264281 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-105588f7-eed6-438d-bd48-246cad56bfcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:06.264736 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-105588f7-eed6-438d-bd48-246cad56bfcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:06.265517 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-105588f7-eed6-438d-bd48-246cad56bfcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:06.265951 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-105588f7-eed6-438d-bd48-246cad56bfcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:06.398233 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-105588f7-eed6-438d-bd48-246cad56bfcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:57:06.405761 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-105588f7-eed6-438d-bd48-246cad56bfcc tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1452 microversion: 2.1 time: 0.152930 May 27 09:57:06.406268 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 632/1261] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:57:06 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:57:08.415599 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-0697d98c-2dc0-4019-99b5-2109ce325ac0 req-56b4402e-cef1-4473-bf5f-c86096d9d652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c255f085-3c23-4a90-86d9-6c4514cc89bd", "tag": "942d0152-92a5-4da9-8fdc-b859b499fcfe"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:57:08.423978 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-0697d98c-2dc0-4019-99b5-2109ce325ac0 req-56b4402e-cef1-4473-bf5f-c86096d9d652 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:57:08.424515 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-0697d98c-2dc0-4019-99b5-2109ce325ac0 req-56b4402e-cef1-4473-bf5f-c86096d9d652 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:57:08.436339 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-0697d98c-2dc0-4019-99b5-2109ce325ac0 req-56b4402e-cef1-4473-bf5f-c86096d9d652 service nova] Creating event network-changed:942d0152-92a5-4da9-8fdc-b859b499fcfe for instance c255f085-3c23-4a90-86d9-6c4514cc89bd on hv-cinder-79760 May 27 09:57:08.441821 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-0697d98c-2dc0-4019-99b5-2109ce325ac0 req-56b4402e-cef1-4473-bf5f-c86096d9d652 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030462 May 27 09:57:08.442815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 630/1262] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:57:13.489611 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:57:13.490279 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Fri May 27 09:57:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:59:06.459599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:59:06.460201 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Fri May 27 09:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:59:16.003150 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:59:16.003918 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Fri May 27 09:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:59:20.482559 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:59:20.483215 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Fri May 27 09:59:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:59:28.353671 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:59:28.354248 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Fri May 27 09:59:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:59:28.665978 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:28.667134 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG dbcounter [-] [129290] Writing DB stats nova_cell1:SELECT=76 {{(pid=129290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:28.670577 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_api:SELECT=30 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:28.671212 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-b60eb78b-d1f7-467f-9021-60556a50e8f7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:28.671425 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG dbcounter [-] [129291] Writing DB stats nova_cell1:SELECT=70 {{(pid=129291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:28.671734 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b60eb78b-d1f7-467f-9021-60556a50e8f7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:28.681863 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b60eb78b-d1f7-467f-9021-60556a50e8f7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:28.682324 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b60eb78b-d1f7-467f-9021-60556a50e8f7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:28.683107 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b60eb78b-d1f7-467f-9021-60556a50e8f7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:28.683574 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-b60eb78b-d1f7-467f-9021-60556a50e8f7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:28.717746 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-b60eb78b-d1f7-467f-9021-60556a50e8f7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Going to try to terminate instance {{(pid=129290) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:59:28.820865 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-b60eb78b-d1f7-467f-9021-60556a50e8f7 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 204 len: 0 microversion: 2.1 time: 0.156336 May 27 09:59:28.821769 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 633/1263] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:59:28 2022] DELETE /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:59:28.822938 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-e885b5de-dd28-416d-8753-4bf596a56dfa req-c7d6f8b1-ab66-4e7b-920f-bfd63fb1f0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c255f085-3c23-4a90-86d9-6c4514cc89bd", "tag": "942d0152-92a5-4da9-8fdc-b859b499fcfe"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:59:28.830342 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-8492ef0c-8cd4-46e5-8383-2cdc66f5d85f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:28.831216 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-8492ef0c-8cd4-46e5-8383-2cdc66f5d85f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:28.837947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8492ef0c-8cd4-46e5-8383-2cdc66f5d85f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:28.838503 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8492ef0c-8cd4-46e5-8383-2cdc66f5d85f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:28.839394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8492ef0c-8cd4-46e5-8383-2cdc66f5d85f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:28.839909 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-8492ef0c-8cd4-46e5-8383-2cdc66f5d85f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:28.845740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-e885b5de-dd28-416d-8753-4bf596a56dfa req-c7d6f8b1-ab66-4e7b-920f-bfd63fb1f0b1 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:28.846529 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-e885b5de-dd28-416d-8753-4bf596a56dfa req-c7d6f8b1-ab66-4e7b-920f-bfd63fb1f0b1 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:28.859988 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-e885b5de-dd28-416d-8753-4bf596a56dfa req-c7d6f8b1-ab66-4e7b-920f-bfd63fb1f0b1 service nova] Creating event network-changed:942d0152-92a5-4da9-8fdc-b859b499fcfe for instance c255f085-3c23-4a90-86d9-6c4514cc89bd on hv-cinder-79760 May 27 09:59:28.867205 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-e885b5de-dd28-416d-8753-4bf596a56dfa req-c7d6f8b1-ab66-4e7b-920f-bfd63fb1f0b1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198857 May 27 09:59:28.871437 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 631/1264] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:59:29.078432 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-8492ef0c-8cd4-46e5-8383-2cdc66f5d85f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:29.089287 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-8492ef0c-8cd4-46e5-8383-2cdc66f5d85f tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1577 microversion: 2.1 time: 0.263266 May 27 09:59:29.089881 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 634/1265] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:59:28 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1577 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:59:30.107449 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-dd7b6da4-1734-4666-9140-e1955fec0b81 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:30.108162 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-dd7b6da4-1734-4666-9140-e1955fec0b81 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:30.114278 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd7b6da4-1734-4666-9140-e1955fec0b81 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:30.114788 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd7b6da4-1734-4666-9140-e1955fec0b81 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:30.115598 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd7b6da4-1734-4666-9140-e1955fec0b81 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:30.116041 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-dd7b6da4-1734-4666-9140-e1955fec0b81 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:30.328926 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-dd7b6da4-1734-4666-9140-e1955fec0b81 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:30.337115 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-dd7b6da4-1734-4666-9140-e1955fec0b81 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1577 microversion: 2.1 time: 0.234818 May 27 09:59:30.337680 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 632/1266] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:59:30 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1577 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:31.355130 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-783979d3-9dbd-4bbb-9ff4-6c85708611d2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:31.355781 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-783979d3-9dbd-4bbb-9ff4-6c85708611d2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:31.362905 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-783979d3-9dbd-4bbb-9ff4-6c85708611d2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:31.363413 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-783979d3-9dbd-4bbb-9ff4-6c85708611d2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:31.364188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-783979d3-9dbd-4bbb-9ff4-6c85708611d2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:31.364625 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-783979d3-9dbd-4bbb-9ff4-6c85708611d2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:31.607486 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-783979d3-9dbd-4bbb-9ff4-6c85708611d2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:31.615623 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-783979d3-9dbd-4bbb-9ff4-6c85708611d2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1577 microversion: 2.1 time: 0.264376 May 27 09:59:31.616198 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 635/1267] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:59:31 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1577 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:31.823654 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-475b99b6-6b73-4139-ae70-d2bf5f3698eb req-d28f8c37-e1ef-4e48-a0b9-e4b008904888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c255f085-3c23-4a90-86d9-6c4514cc89bd", "name": "network-vif-deleted", "tag": "942d0152-92a5-4da9-8fdc-b859b499fcfe"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:59:31.836416 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-475b99b6-6b73-4139-ae70-d2bf5f3698eb req-d28f8c37-e1ef-4e48-a0b9-e4b008904888 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:31.837149 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-475b99b6-6b73-4139-ae70-d2bf5f3698eb req-d28f8c37-e1ef-4e48-a0b9-e4b008904888 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:31.849452 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-475b99b6-6b73-4139-ae70-d2bf5f3698eb req-d28f8c37-e1ef-4e48-a0b9-e4b008904888 service nova] Creating event network-vif-deleted:942d0152-92a5-4da9-8fdc-b859b499fcfe for instance c255f085-3c23-4a90-86d9-6c4514cc89bd on hv-cinder-79760 May 27 09:59:31.854765 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-475b99b6-6b73-4139-ae70-d2bf5f3698eb req-d28f8c37-e1ef-4e48-a0b9-e4b008904888 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034831 May 27 09:59:31.855377 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 633/1268] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:59:32.632592 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:32.633196 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:32.639620 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:32.640071 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:32.640825 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:32.641256 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:32.672264 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:32.672713 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:32.673218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.objects.instance [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lazy-loading 'fault' on Instance uuid c255f085-3c23-4a90-86d9-6c4514cc89bd {{(pid=129290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:59:32.715928 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:32.723232 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-34da7081-a522-4d88-b0d1-b2a8c4bc8e2e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 200 len: 1184 microversion: 2.1 time: 0.095069 May 27 09:59:32.723811 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 636/1269] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:59:32 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 1184 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:33.741409 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a3df49bf-bcc8-429b-889b-cb71b6a695a0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:33.742097 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-a3df49bf-bcc8-429b-889b-cb71b6a695a0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: c255f085-3c23-4a90-86d9-6c4514cc89bd] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:33.748248 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3df49bf-bcc8-429b-889b-cb71b6a695a0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:33.748735 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3df49bf-bcc8-429b-889b-cb71b6a695a0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:33.749504 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3df49bf-bcc8-429b-889b-cb71b6a695a0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:33.749951 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-a3df49bf-bcc8-429b-889b-cb71b6a695a0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:33.763231 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-a3df49bf-bcc8-429b-889b-cb71b6a695a0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] HTTP exception thrown: Instance c255f085-3c23-4a90-86d9-6c4514cc89bd could not be found. May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a3df49bf-bcc8-429b-889b-cb71b6a695a0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Request method failure captured: May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd HTTP/1.1 May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ7zp-hV1znBYHXXcYN4xBIPDL0Hj-BZ4ZYsItQxyY_4ebbDF8y9_oItdL2GbEvG5SOshLmHcmP9aTfPkWRKTHUoRyOykU4fQmbe2IjFN2o_PMD0wRsyyM19EB_al3PEaGqYXy394jYKko6TRvzVlxyZwfL5FmsKXOun1CEfKwUfWjs May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 0fb2f335c9b540af8f7119c85656efad May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-TestVolumeBootPattern-712456051 May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:59:33.764815 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0fb2f335c9b540af8f7119c85656efad"}]}] May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-TestVolumeBootPattern-712456051 May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 0fb2f335c9b540af8f7119c85656efad May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-TestVolumeBootPattern-712456051 May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-TestVolumeBootPattern-712456051-project May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: f1fa5f1765ed4995b31a1600ce3edb07 May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-TestVolumeBootPattern-712456051-project May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance c255f085-3c23-4a90-86d9-6c4514cc89bd could not be found. May 27 09:59:33.766564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'c255f085-3c23-4a90-86d9-6c4514cc89bd'} May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c255f085-3c23-4a90-86d9-6c4514cc89bd could not be found. May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:59:33.767603 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c255f085-3c23-4a90-86d9-6c4514cc89bd could not be found. May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c255f085-3c23-4a90-86d9-6c4514cc89bd could not be found. May 27 09:59:33.769740 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:59:33.771031 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-a3df49bf-bcc8-429b-889b-cb71b6a695a0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Returning 404 to user: Instance c255f085-3c23-4a90-86d9-6c4514cc89bd could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:59:33.771031 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-a3df49bf-bcc8-429b-889b-cb71b6a695a0 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd" status: 404 len: 111 microversion: 2.1 time: 0.029806 May 27 09:59:33.771031 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 634/1270] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:59:33 2022] GET /compute/v2.1/servers/c255f085-3c23-4a90-86d9-6c4514cc89bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:59:36.803241 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-5a9c16ce-278f-480b-8aba-b7936ed7a4a9 req-a97313aa-40d8-4132-9d71-f4b09a85de07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe94756-b459-402b-ae34-6c33212dbfeb", "tag": "a5872eee-9e8c-4b27-9455-b29cc8304599"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:59:36.809891 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-3c0a8052-a287-4947-be40-d81417e1764e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:36.810394 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3c0a8052-a287-4947-be40-d81417e1764e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:36.817226 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3c0a8052-a287-4947-be40-d81417e1764e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:36.817675 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3c0a8052-a287-4947-be40-d81417e1764e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:36.818119 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-5a9c16ce-278f-480b-8aba-b7936ed7a4a9 req-a97313aa-40d8-4132-9d71-f4b09a85de07 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:36.818440 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3c0a8052-a287-4947-be40-d81417e1764e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:36.818559 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-5a9c16ce-278f-480b-8aba-b7936ed7a4a9 req-a97313aa-40d8-4132-9d71-f4b09a85de07 service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:36.818869 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-3c0a8052-a287-4947-be40-d81417e1764e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:36.829564 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-5a9c16ce-278f-480b-8aba-b7936ed7a4a9 req-a97313aa-40d8-4132-9d71-f4b09a85de07 service nova] Creating event network-changed:a5872eee-9e8c-4b27-9455-b29cc8304599 for instance 7fe94756-b459-402b-ae34-6c33212dbfeb on hv-cinder-79760 May 27 09:59:36.835559 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-5a9c16ce-278f-480b-8aba-b7936ed7a4a9 req-a97313aa-40d8-4132-9d71-f4b09a85de07 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036485 May 27 09:59:36.836597 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 635/1271] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:59:36.844947 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-3c0a8052-a287-4947-be40-d81417e1764e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Going to try to terminate instance {{(pid=129290) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:59:36.953823 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-3c0a8052-a287-4947-be40-d81417e1764e tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 204 len: 0 microversion: 2.1 time: 0.156910 May 27 09:59:36.955218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 637/1272] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:59:36 2022] DELETE /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:59:36.966018 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-1afaf610-d417-4bcc-b904-ca57c6da59e2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:36.966817 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-1afaf610-d417-4bcc-b904-ca57c6da59e2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:36.974226 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1afaf610-d417-4bcc-b904-ca57c6da59e2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:36.975068 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1afaf610-d417-4bcc-b904-ca57c6da59e2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:36.976390 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1afaf610-d417-4bcc-b904-ca57c6da59e2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:36.976903 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-1afaf610-d417-4bcc-b904-ca57c6da59e2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:37.186418 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.policy [None req-1afaf610-d417-4bcc-b904-ca57c6da59e2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129291) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:37.197644 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-1afaf610-d417-4bcc-b904-ca57c6da59e2 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1575 microversion: 2.1 time: 0.235907 May 27 09:59:37.198829 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 636/1273] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:59:36 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1575 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:38.216793 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-2d0f1599-a21a-41d6-8f2d-4c6ba7b7304d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:38.217502 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-2d0f1599-a21a-41d6-8f2d-4c6ba7b7304d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:38.225095 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d0f1599-a21a-41d6-8f2d-4c6ba7b7304d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:38.225599 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d0f1599-a21a-41d6-8f2d-4c6ba7b7304d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:38.226447 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d0f1599-a21a-41d6-8f2d-4c6ba7b7304d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:38.227086 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-2d0f1599-a21a-41d6-8f2d-4c6ba7b7304d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:38.319840 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.policy [None req-2d0f1599-a21a-41d6-8f2d-4c6ba7b7304d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1fa5f1765ed4995b31a1600ce3edb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb2f335c9b540af8f7119c85656efad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129290) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:38.328321 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-2d0f1599-a21a-41d6-8f2d-4c6ba7b7304d tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 200 len: 1390 microversion: 2.1 time: 0.115818 May 27 09:59:38.328901 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 638/1274] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:59:38 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 1390 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:38.334310 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [req-f8af2ed0-c208-4d2e-b8fc-d2004cfba3aa req-a8569302-9559-479a-ae2f-ae39c6d1fb9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe94756-b459-402b-ae34-6c33212dbfeb", "name": "network-vif-deleted", "tag": "a5872eee-9e8c-4b27-9455-b29cc8304599"}]} {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:59:38.343101 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-f8af2ed0-c208-4d2e-b8fc-d2004cfba3aa req-a8569302-9559-479a-ae2f-ae39c6d1fb9d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:38.343594 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [req-f8af2ed0-c208-4d2e-b8fc-d2004cfba3aa req-a8569302-9559-479a-ae2f-ae39c6d1fb9d service nova] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:38.355024 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.compute.server_external_events [req-f8af2ed0-c208-4d2e-b8fc-d2004cfba3aa req-a8569302-9559-479a-ae2f-ae39c6d1fb9d service nova] Creating event network-vif-deleted:a5872eee-9e8c-4b27-9455-b29cc8304599 for instance 7fe94756-b459-402b-ae34-6c33212dbfeb on hv-cinder-79760 May 27 09:59:38.359733 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [req-f8af2ed0-c208-4d2e-b8fc-d2004cfba3aa req-a8569302-9559-479a-ae2f-ae39c6d1fb9d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029866 May 27 09:59:38.360332 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 637/1275] 10.222.0.41 () {64 vars in 1317 bytes} [Fri May 27 09:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:59:39.345648 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-127ee709-f490-4f8b-a2de-abe45b46e200 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:39.346296 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-127ee709-f490-4f8b-a2de-abe45b46e200 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: 7fe94756-b459-402b-ae34-6c33212dbfeb] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:39.352966 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-127ee709-f490-4f8b-a2de-abe45b46e200 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:39.353409 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-127ee709-f490-4f8b-a2de-abe45b46e200 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:39.354161 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-127ee709-f490-4f8b-a2de-abe45b46e200 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:39.354590 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-127ee709-f490-4f8b-a2de-abe45b46e200 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:39.368298 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-127ee709-f490-4f8b-a2de-abe45b46e200 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] HTTP exception thrown: Instance 7fe94756-b459-402b-ae34-6c33212dbfeb could not be found. May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-127ee709-f490-4f8b-a2de-abe45b46e200 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Request method failure captured: May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb HTTP/1.1 May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ7zp-hV1znBYHXXcYN4xBIPDL0Hj-BZ4ZYsItQxyY_4ebbDF8y9_oItdL2GbEvG5SOshLmHcmP9aTfPkWRKTHUoRyOykU4fQmbe2IjFN2o_PMD0wRsyyM19EB_al3PEaGqYXy394jYKko6TRvzVlxyZwfL5FmsKXOun1CEfKwUfWjs May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 0fb2f335c9b540af8f7119c85656efad May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-TestVolumeBootPattern-712456051 May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:59:39.369898 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0fb2f335c9b540af8f7119c85656efad"}]}] May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-TestVolumeBootPattern-712456051 May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 0fb2f335c9b540af8f7119c85656efad May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-TestVolumeBootPattern-712456051 May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-TestVolumeBootPattern-712456051-project May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: f1fa5f1765ed4995b31a1600ce3edb07 May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-TestVolumeBootPattern-712456051-project May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance 7fe94756-b459-402b-ae34-6c33212dbfeb could not be found. May 27 09:59:39.371764 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': '7fe94756-b459-402b-ae34-6c33212dbfeb'} May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe94756-b459-402b-ae34-6c33212dbfeb could not be found. May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:59:39.372745 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe94756-b459-402b-ae34-6c33212dbfeb could not be found. May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe94756-b459-402b-ae34-6c33212dbfeb could not be found. May 27 09:59:39.374381 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:59:39.375855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-127ee709-f490-4f8b-a2de-abe45b46e200 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Returning 404 to user: Instance 7fe94756-b459-402b-ae34-6c33212dbfeb could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:59:39.375855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-127ee709-f490-4f8b-a2de-abe45b46e200 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb" status: 404 len: 111 microversion: 2.1 time: 0.029575 May 27 09:59:39.375855 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 639/1276] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:59:39 2022] GET /compute/v2.1/servers/7fe94756-b459-402b-ae34-6c33212dbfeb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 09:59:39.803934 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-61fca7bb-ee4a-40e0-af14-5d429571f07a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:39.804503 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.compute.api [None req-61fca7bb-ee4a-40e0-af14-5d429571f07a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129291) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:39.810646 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-61fca7bb-ee4a-40e0-af14-5d429571f07a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:39.811096 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-61fca7bb-ee4a-40e0-af14-5d429571f07a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:39.811883 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-61fca7bb-ee4a-40e0-af14-5d429571f07a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:39.812320 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG oslo_concurrency.lockutils [None req-61fca7bb-ee4a-40e0-af14-5d429571f07a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:39.825368 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.wsgi [None req-61fca7bb-ee4a-40e0-af14-5d429571f07a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] HTTP exception thrown: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-61fca7bb-ee4a-40e0-af14-5d429571f07a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Request method failure captured: May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: request: DELETE /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b HTTP/1.1 May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept: application/json May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Accept-Encoding: identity May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Connection: close May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Length: 0 May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Content-Type: application/json May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Host: 10.222.0.41 May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Openstack-System-Scope: None May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: User-Agent: python-urllib3/1.26.9 May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Auth-Token: gAAAAABikJ7zp-hV1znBYHXXcYN4xBIPDL0Hj-BZ4ZYsItQxyY_4ebbDF8y9_oItdL2GbEvG5SOshLmHcmP9aTfPkWRKTHUoRyOykU4fQmbe2IjFN2o_PMD0wRsyyM19EB_al3PEaGqYXy394jYKko6TRvzVlxyZwfL5FmsKXOun1CEfKwUfWjs May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Id: None May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Domain-Name: None May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Identity-Status: Confirmed May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Is-Admin-Project: True May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Id: default May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Domain-Name: Default May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Id: 0fb2f335c9b540af8f7119c85656efad May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Project-Name: tempest-TestVolumeBootPattern-712456051 May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Role: reader,member May 27 09:59:39.826992 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Roles: reader,member May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0fb2f335c9b540af8f7119c85656efad"}]}] May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant: tempest-TestVolumeBootPattern-712456051 May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Id: 0fb2f335c9b540af8f7119c85656efad May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-Tenant-Name: tempest-TestVolumeBootPattern-712456051 May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User: tempest-TestVolumeBootPattern-712456051-project May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Id: default May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Domain-Name: Default May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Id: f1fa5f1765ed4995b31a1600ce3edb07 May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: X-User-Name: tempest-TestVolumeBootPattern-712456051-project May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: method: > May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: exception: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:59:39.828693 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: action_args: {'id': 'd0e13117-8fb3-47ff-86e7-79d912a1482b'} May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:59:39.829566 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:59:39.831501 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR nova.api.openstack.wsgi May 27 09:59:39.832880 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-61fca7bb-ee4a-40e0-af14-5d429571f07a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Returning 404 to user: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. {{(pid=129291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:59:39.832880 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-61fca7bb-ee4a-40e0-af14-5d429571f07a tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 404 len: 111 microversion: 2.1 time: 0.030055 May 27 09:59:39.832880 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 638/1277] 10.222.0.41 () {58 vars in 1238 bytes} [Fri May 27 09:59:39 2022] DELETE /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:59:39.838320 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e0bea786-4448-413c-a60e-fe4150f0a473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '>' {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:39.838924 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.compute.api [None req-e0bea786-4448-413c-a60e-fe4150f0a473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [instance: d0e13117-8fb3-47ff-86e7-79d912a1482b] Fetching instance by UUID {{(pid=129290) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:39.844991 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e0bea786-4448-413c-a60e-fe4150f0a473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:39.845434 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e0bea786-4448-413c-a60e-fe4150f0a473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:39.846188 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e0bea786-4448-413c-a60e-fe4150f0a473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:39.847205 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG oslo_concurrency.lockutils [None req-e0bea786-4448-413c-a60e-fe4150f0a473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Lock "e023520c-85e2-4ea4-af21-7ff61f036f3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:39.860218 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.wsgi [None req-e0bea786-4448-413c-a60e-fe4150f0a473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] HTTP exception thrown: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e0bea786-4448-413c-a60e-fe4150f0a473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Request method failure captured: May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: request: GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b HTTP/1.1 May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept: application/json May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Accept-Encoding: identity May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Connection: close May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Length: 0 May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Content-Type: application/json May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Host: 10.222.0.41 May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Openstack-System-Scope: None May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: User-Agent: python-urllib3/1.26.9 May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Auth-Token: gAAAAABikJ7zp-hV1znBYHXXcYN4xBIPDL0Hj-BZ4ZYsItQxyY_4ebbDF8y9_oItdL2GbEvG5SOshLmHcmP9aTfPkWRKTHUoRyOykU4fQmbe2IjFN2o_PMD0wRsyyM19EB_al3PEaGqYXy394jYKko6TRvzVlxyZwfL5FmsKXOun1CEfKwUfWjs May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Id: None May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Domain-Name: None May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Identity-Status: Confirmed May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Is-Admin-Project: True May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Id: default May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Domain-Name: Default May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Id: 0fb2f335c9b540af8f7119c85656efad May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Project-Name: tempest-TestVolumeBootPattern-712456051 May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Role: reader,member May 27 09:59:39.861689 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Roles: reader,member May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fb2f335c9b540af8f7119c85656efad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.41:8080", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0fb2f335c9b540af8f7119c85656efad"}]}] May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant: tempest-TestVolumeBootPattern-712456051 May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Id: 0fb2f335c9b540af8f7119c85656efad May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-Tenant-Name: tempest-TestVolumeBootPattern-712456051 May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User: tempest-TestVolumeBootPattern-712456051-project May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Id: default May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Domain-Name: Default May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Id: f1fa5f1765ed4995b31a1600ce3edb07 May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: X-User-Name: tempest-TestVolumeBootPattern-712456051-project May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: method: > May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: exception: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:59:39.863425 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: action_args: {'id': 'd0e13117-8fb3-47ff-86e7-79d912a1482b'} May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: {{(pid=129290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:59:39.864337 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. May 27 09:59:39.865914 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: ERROR nova.api.openstack.wsgi May 27 09:59:39.867361 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: DEBUG nova.api.openstack.wsgi [None req-e0bea786-4448-413c-a60e-fe4150f0a473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Returning 404 to user: Instance d0e13117-8fb3-47ff-86e7-79d912a1482b could not be found. {{(pid=129290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:59:39.867361 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO nova.api.openstack.requestlog [None req-e0bea786-4448-413c-a60e-fe4150f0a473 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b" status: 404 len: 111 microversion: 2.1 time: 0.028544 May 27 09:59:39.867361 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: [pid: 129290|app: 0|req: 640/1278] 10.222.0.41 () {58 vars in 1235 bytes} [Fri May 27 09:59:39 2022] GET /compute/v2.1/servers/d0e13117-8fb3-47ff-86e7-79d912a1482b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:59:41.147703 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: DEBUG nova.api.openstack.wsgi [None req-3f966262-a212-4a52-bdd4-cb09a43f51b8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] Calling method '.version_select at 0x7f1890a720d0>' {{(pid=129291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:41.151017 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3f966262-a212-4a52-bdd4-cb09a43f51b8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [f504c7da-7dda-4d6f-a918-9e028ea7b549] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 09:59:42.158559 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO oslo.messaging._drivers.impl_rabbit [None req-3f966262-a212-4a52-bdd4-cb09a43f51b8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] [f504c7da-7dda-4d6f-a918-9e028ea7b549] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 59316. May 27 09:59:42.177687 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO nova.api.openstack.requestlog [None req-3f966262-a212-4a52-bdd4-cb09a43f51b8 tempest-TestVolumeBootPattern-712456051 tempest-TestVolumeBootPattern-712456051-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-830294606" status: 202 len: 0 microversion: 2.1 time: 1.034423 May 27 09:59:42.178269 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: [pid: 129291|app: 0|req: 639/1279] 10.222.0.41 () {58 vars in 1259 bytes} [Fri May 27 09:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-830294606 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 10:00:33.499203 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:00:33.499957 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Fri May 27 10:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:02:26.468131 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:02:26.468739 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Fri May 27 10:02:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:02:36.011665 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:02:36.012766 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Fri May 27 10:02:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:02:40.495595 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:02:40.496384 dv-cinder-797608-21-iscsi devstack@n-api.service[129290]: Fri May 27 10:02:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:02:48.361996 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:02:48.362505 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Fri May 27 10:02:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:03:53.507363 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:03:53.508667 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Fri May 27 10:03:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:05:00.898889 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:05:00.899657 dv-cinder-797608-21-iscsi devstack@n-api.service[129291]: Fri May 27 10:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!